check freshness of active check?

ormsbeec · Post by **ormsbeec** » Fri Jun 17, 2011 11:07 am

Is it possible to check the freshness of an active check? and if so how do I alert that the check has gone stale?

Post by **nscott** » Fri Jun 17, 2011 2:29 pm

ormsbeec,

Active checks are meant to not be stale. It would be similar to putting an active check on an active check, if one is in that situation, it would be most prudent to fix the active check, because if its not returning a critical values then its not serving its purpose. Is there an extenuating circumstance that requires a freshness check on an active check?

ormsbeec · Post by **ormsbeec** » Fri Jun 17, 2011 3:36 pm

I occasionally run into instances where my active checks have been sitting for an extended period of time not updating. Generally when this happens there are a bunch of defunct nagios processes that need to be cleared up. Perhaps the freshness check would not even work in this situation.. but if every host and host check went red in this case at least there might be a chance our noc would let someone know.

Now, to add this doesnt happen very often; just trying to figure out an automated way to alert in this type of instance.

Post by **nscott** » Fri Jun 17, 2011 4:17 pm

Understood. Thanks makes sense.

Do you have a cron job in place to reap zombies? That would be a possible solution.

I'm sure you've read it but I will reference it anyways.

http://nagios.manubulon.com/traduction/ ... hness.html

So you could freshness checks on those active checks, however I'm unsure whether or not they will get pulled under by zombie processes or not.

ormsbeec · Post by **ormsbeec** » Tue Jun 21, 2011 9:38 am

nscott wrote:Understood. Thanks makes sense.

Do you have a cron job in place to reap zombies? That would be a possible solution.

I'm sure you've read it but I will reference it anyways.

http://nagios.manubulon.com/traduction/ ... hness.html

So you could freshness checks on those active checks, however I'm unsure whether or not they will get pulled under by zombie processes or not.

Ill get a death script in place to reap zombies. Thanks for the follow up.

mguthrie · Post by **mguthrie** » Tue Jun 21, 2011 4:47 pm

What version of XI are you using? We did have a bug in older version of Nagios that occasionally allowed a 2nd instance of Nagios to spawn, causing unpredictable results. That bug has been fixed starting in 2011R1.4.

ormsbeec · Post by **ormsbeec** » Wed Jun 22, 2011 9:39 am

mguthrie wrote:What version of XI are you using? We did have a bug in older version of Nagios that occasionally allowed a 2nd instance of Nagios to spawn, causing unpredictable results. That bug has been fixed starting in 2011R1.4.

I actually had just upgraded to 2011R1.4 from 1.3.

mguthrie · Post by **mguthrie** » Wed Jun 22, 2011 2:59 pm

Hmm...can I have you check the following things:

Is the hard drive full? ( I hate to ask, but it can cause this).

What do the permissions look like for /usr/local/nagios/var/spool/checkresults?
Should be:

Code: Select all

drwxrwxr-x 2 nagios nagios  36864 Jun 22 14:57 checkresults

Can you run:

Code: Select all

killall -9 nagios
service ndo2db stop
service nagios start
service ndo2db start

ormsbeec · Post by **ormsbeec** » Wed Jun 22, 2011 4:43 pm

The problem did not actually happen with 1.4, I upgraded soon after posting this. I have since went back to 1.3. I think this topic can be closed.

mguthrie · Post by **mguthrie** » Thu Jun 23, 2011 9:22 am

See our global announcement:
http://support.nagios.com/forum/viewtop ... =16&t=2585

Nagios Support Forum

check freshness of active check?

check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?

Re: check freshness of active check?