Nagios Support Forum

The better part of a year has passed and there was no occurrence, so I can safely say this solved my problem.

In case someone happens upon this thread, please see this page for the jist of it:
http://www.unixarena.com/2013/12/how-to ... edhat.html

Okay - I think I found the problem. I say "think", because this is one of those "it makes sense, but I don't have hard-proof yet" things. I was looking at the kernel thread limit, which is indeed ~140k - however, I did not look at the per-user pending signals limit, which is abou...

In order: 1. I very much doubt this is a perl issue. 100% of my plugins are perl based, but when I run the same plugins exactly (copy-paste, adjusting for resource/host variables, from the configuration) from the command line while this is happening, all is well. 2. I just checked - no segfaults whi...

More info: Reloading Nagios apparently doesn't solve the problem (just restarting) so I was able to do a little debugging: Adding the "capture_plugin" to the relevant service commands changes the output from (null) to: Can't locate Module/Runtime.pm in @INC (@INC contains: /usr/local/nagio...

It happened again in a different environment - one in which I could afford a couple hours of downtime before restarting. I had a chance to study this a little, and just got more confused in the process. It turns out this issue does not happen for all services. The common ground I could find for all ...

This is a service check we're talking about, and not a host check, right?

If so - off the top of my head: make sure the host under which the service resides is UP. Otherwise this will appear in the Unhandled Hosts page, rather than the Unhandled Services Page.

Okay - it finally happened again. The graph shows a spike of up to ~70k threads, but it's nowhere near the 140k kernel limit.
Might it still be the case? If not, any other ideas? I must admit I'm at a loss here.

Interesting point.
I just added a service to monitor this. I'll wait for the next time this happens to correlate, and update here.

Thanks!

Hey there, This problem has been bothering me for a while and I haven't yet managed to properly debug it or Google up a solution. The gist of it: every now and then - on average once a week - all services in our Nagios installation return CRITICAL with an output of (null). The only thing that solves...