Page 1 of 1
Alerting not working on Nagios Log Server
Posted: Thu Jan 31, 2019 9:08 pm
by Sampath.Basireddy
I created few alerts on Nagios Log Server. When I run them manually, they seem to be working fine, but when they are run by "run_all_alerts" job, I don't see any alerts triggering.
Alerts are configured with 5min interval with lookback period of 15mins.
This afternoon the alerts were supposed to be triggered as the conditions met, but nothing triggered and now when I changed the lookback period to 12hrs and ran the alert, alerts came through.
Please suggest.
Re: Alerting not working on Nagios Log Server
Posted: Fri Feb 01, 2019 8:33 am
by scottwilkerson
If you go to Admin -> Command Subsystem
Is the Last Run Time for run_all_alerts a current time? Also, is the status of all the jobs "Waiting"?
Re: Alerting not working on Nagios Log Server
Posted: Fri Feb 01, 2019 10:34 am
by Sampath.Basireddy
Yes, Last Run Time looks to be correct and the Next Run Time too aligns with the Frequency setup.
Here is the screenshot:
Re: Alerting not working on Nagios Log Server
Posted: Fri Feb 01, 2019 3:32 pm
by scottwilkerson
Just curious, after you set them for 12hrs lookback do you continue to receive the alerts?
Re: Alerting not working on Nagios Log Server
Posted: Fri Feb 01, 2019 5:56 pm
by Sampath.Basireddy
Yes, it works.
Looks like I may have figured it. Since the time is set to UTC on our NLS, the "Events Over Time" dashboard is according to UTC, but the data is available as per CST.
I changed the "Lookback Period" to 365mins (6hrs 5mins) which appears to have taken care of it.
Re: Alerting not working on Nagios Log Server
Posted: Sat Feb 02, 2019 3:57 pm
by Sampath.Basireddy
Sampath.Basireddy wrote:Yes, it works.
Looks like I may have figured it. Since the time is set to UTC on our NLS, the "Events Over Time" dashboard is according to UTC, but the data is available as per CST.
I changed the "Lookback Period" to 365mins (6hrs 5mins) which appears to have taken care of it.
This didn't work either. It worked the minute I changed the alerts to look for 365mins, but this morning there was supposed to be an alert triggered, but no alert came through.
And for your question about 12hrs, yes, that is working. I just changed the lookback period to 12hrs and yes, alert triggered.
Re: Alerting not working on Nagios Log Server
Posted: Mon Feb 04, 2019 8:29 am
by scottwilkerson
You may want to try slightly longer than the 365mins as what you thought should have been an alert may have been split between 2 periods
maybe 370mins
Re: Alerting not working on Nagios Log Server
Posted: Wed Feb 06, 2019 4:41 pm
by Sampath.Basireddy
@scottwilkerson, Yep, tried that and looks to be working for now.
Thank You.
Re: Alerting not working on Nagios Log Server
Posted: Wed Feb 06, 2019 4:49 pm
by cdienger
Glad to hear. Are we okay to lock this up?