Alerts don't run

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
weveland
Posts: 125
Joined: Tue Aug 11, 2015 4:10 pm
Location: cat /dev/urandom > /dev/sda

Alerts don't run

Post by weveland »

System: Log Server 2015R2.2 on CentOS 6.7 (from image)

Issue: Alerts don't run automatically

Guys/Gals,

I've created a few alerts from dashboards within the log server. However even though I specify a interval of 5m and a lookback of 5m the alerts never seem to run themselves. The Last run time never changes unless I choose to manually run the check now. Any ideas what I could be doing wrong?

--
Wayne
jolson
Attack Rabbit
Posts: 2560
Joined: Thu Feb 12, 2015 12:40 pm

Re: Alerts don't run

Post by jolson »

What timezone are you in? I'm currently exploring an issue that may affect alerts while using the 'JST' timezone.

Otherwise, this could be related to the jobs subsystem.

Try restarting crond on your servers:

Code: Select all

service crond restart
Give the jobs a reset:
2015-09-02 09_59_11-Cortana.png
Are any of your other jobs not firing, or is it your alerting functions exclusively?
You do not have the required permissions to view the files attached to this post.
Twits Blog
Show me a man who lives alone and has a perpetually clean kitchen, and 8 times out of 9 I'll show you a man with detestable spiritual qualities.
weveland
Posts: 125
Joined: Tue Aug 11, 2015 4:10 pm
Location: cat /dev/urandom > /dev/sda

Re: Alerts don't run

Post by weveland »

Thanks jolson,

It appeared the alert service hadn't run since 8/14. But all the rest of them looked fine. I'll let you know in a few if the alerts ran or not.
jolson
Attack Rabbit
Posts: 2560
Joined: Thu Feb 12, 2015 12:40 pm

Re: Alerts don't run

Post by jolson »

Sounds good, I'll standby for your response.
Twits Blog
Show me a man who lives alone and has a perpetually clean kitchen, and 8 times out of 9 I'll show you a man with detestable spiritual qualities.
weveland
Posts: 125
Joined: Tue Aug 11, 2015 4:10 pm
Location: cat /dev/urandom > /dev/sda

Re: Alerts don't run

Post by weveland »

Perfect! worked great.

Any idea why the job would have been suck, or anything I can do to prevent it in the future?
weveland
Posts: 125
Joined: Tue Aug 11, 2015 4:10 pm
Location: cat /dev/urandom > /dev/sda

Re: Alerts don't run

Post by weveland »

Also I forgot to answer your other question. I'm in the Eastern Standard Timezone (EST/EDT)
jolson
Attack Rabbit
Posts: 2560
Joined: Thu Feb 12, 2015 12:40 pm

Re: Alerts don't run

Post by jolson »

Any idea why the job would have been suck, or anything I can do to prevent it in the future?
Typically jobs don't stick randomly - was there anything that you were doing in particular that might have caused the subsystem to freeze up? This might include disks filling up, server restarts, or instance outages.
I'm in the Eastern Standard Timezone (EST/EDT)
Thanks for the information - there's no evidence of the JST problem affecting US users. I'm still working on debugging exactly what the problem is for the JST timezone.
Twits Blog
Show me a man who lives alone and has a perpetually clean kitchen, and 8 times out of 9 I'll show you a man with detestable spiritual qualities.
weveland
Posts: 125
Joined: Tue Aug 11, 2015 4:10 pm
Location: cat /dev/urandom > /dev/sda

Re: Alerts don't run

Post by weveland »

I've restarted the server manually. But that's about it.
jolson
Attack Rabbit
Posts: 2560
Joined: Thu Feb 12, 2015 12:40 pm

Re: Alerts don't run

Post by jolson »

It's possible that your server restart may have caused the jobs to freeze. Does the server restart time line up with the time your alerts stopped running?
Twits Blog
Show me a man who lives alone and has a perpetually clean kitchen, and 8 times out of 9 I'll show you a man with detestable spiritual qualities.
weveland
Posts: 125
Joined: Tue Aug 11, 2015 4:10 pm
Location: cat /dev/urandom > /dev/sda

Re: Alerts don't run

Post by weveland »

It does not appear so.
Locked