No rrd files being created

[Bionic___]

Although I have enabled performance data on all of my hosts and some of my services, I cannot get performance graphs. I checked the server and there are no rrd files being created. I have upgraded, checked the help at http://support.nagios.com/wiki/index.ph ... h_Problems but it does not seem to have anything that addresses the failure to create rrd files. I am not sure where to go next.

[slansing]

Can you show the output of the following:

Code: Select all

service npcd status

ls /usr/local/nagios/var/spool/xidpe/ | wc -l

ls /usr/local/nagios/var/spool/perfdata/ | wc -l

tail -50 /usr/local/nagios/var/npcd.log

[Bionic___]

Can you show the output of the following:

Code: Select all

service npcd status

ls /usr/local/nagios/var/spool/xidpe/ | wc -l

ls /usr/local/nagios/var/spool/perfdata/ | wc -l

tail -50 /usr/local/nagios/var/npcd.log

service npcd status
result="NPCD running"

ls /usr/local/nagios/var/spool/xidpe/ | wc -l
result="818215" when run a few seconds later it was "818219"

ls /usr/local/nagios/var/spool/perfdata/ | wc -l
result="0"


tail -50 /usr/local/nagios/var/npcd.log
result in following code block:

Code: Select all

[10-30-2013 09:44:43] NPCD: npcd Daemon (0.4.14) started with PID=32200
[10-30-2013 09:44:43] NPCD: Please have a look at 'npcd -V' to get license information
[10-30-2013 09:44:43] NPCD: HINT: load_threshold is enabled - ('10.000000')
[10-30-2013 13:01:57] NPCD: Caught Termination Signal - Hasta la vista... baby
[10-30-2013 13:05:37] NPCD: npcd Daemon (0.4.14) started with PID=2868
[10-30-2013 13:05:37] NPCD: Please have a look at 'npcd -V' to get license information
[10-30-2013 13:05:37] NPCD: HINT: load_threshold is enabled - ('10.000000')
[11-02-2013 11:12:38] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=0[11-04-2013 14:08:20] NPCD: Caught Termination Signal - Hasta la vista... baby
[11-04-2013 14:12:02] NPCD: npcd Daemon (0.4.14) started with PID=2889
[11-04-2013 14:12:02] NPCD: Please have a look at 'npcd -V' to get license information
[11-04-2013 14:12:02] NPCD: HINT: load_threshold is enabled - ('10.000000')
[11-13-2013 16:02:45] NPCD: WARN: MAX load reached: load 11.080000/10.000000 at i=0[11-13-2013 16:03:01] NPCD: WARN: MAX load reached: load 10.380000/10.000000 at i=1[11-13-2013 16:17:39] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[11-13-2013 16:36:37] NPCD: WARN: MAX load reached: load 10.610000/10.000000 at i=0[11-13-2013 16:36:59] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=1[11-13-2013 16:38:33] NPCD: WARN: MAX load reached: load 10.290000/10.000000 at i=0[11-13-2013 16:43:18] NPCD: WARN: MAX load reached: load 11.400000/10.000000 at i=0[11-13-2013 16:43:37] NPCD: WARN: MAX load reached: load 12.350000/10.000000 at i=1[11-13-2013 16:43:52] NPCD: WARN: MAX load reached: load 11.120000/10.000000 at i=1[11-13-2013 16:44:07] NPCD: WARN: MAX load reached: load 10.560000/10.000000 at i=1[11-13-2013 16:49:27] NPCD: WARN: MAX load reached: load 10.470000/10.000000 at i=0[11-13-2013 16:50:46] NPCD: WARN: MAX load reached: load 10.490000/10.000000 at i=0[12-17-2013 14:26:23] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[12-17-2013 14:30:10] NPCD: WARN: MAX load reached: load 10.260000/10.000000 at i=0[12-17-2013 14:30:25] NPCD: WARN: MAX load reached: load 11.570000/10.000000 at i=1[12-17-2013 14:31:12] NPCD: WARN: MAX load reached: load 12.910000/10.000000 at i=0[12-17-2013 14:31:27] NPCD: WARN: MAX load reached: load 22.440000/10.000000 at i=1[12-17-2013 14:31:42] NPCD: WARN: MAX load reached: load 20.350000/10.000000 at i=1[12-17-2013 14:31:57] NPCD: WARN: MAX load reached: load 16.740000/10.000000 at i=1[12-17-2013 14:32:12] NPCD: WARN: MAX load reached: load 17.470000/10.000000 at i=1[12-17-2013 14:32:27] NPCD: WARN: MAX load reached: load 17.110000/10.000000 at i=1[12-17-2013 14:32:43] NPCD: WARN: MAX load reached: load 16.890000/10.000000 at i=1[12-17-2013 14:32:58] NPCD: WARN: MAX load reached: load 22.800000/10.000000 at i=1[12-17-2013 14:33:14] NPCD: WARN: MAX load reached: load 27.640000/10.000000 at i=1[12-17-2013 14:33:29] NPCD: WARN: MAX load reached: load 23.150000/10.000000 at i=1[12-17-2013 14:33:44] NPCD: WARN: MAX load reached: load 18.380000/10.000000 at i=1[12-17-2013 14:33:59] NPCD: WARN: MAX load reached: load 14.540000/10.000000 at i=1[12-17-2013 14:34:14] NPCD: WARN: MAX load reached: load 11.920000/10.000000 at i=1[12-20-2013 15:01:38] NPCD: WARN: MAX load reached: load 10.420000/10.000000 at i=0[12-20-2013 15:01:53] NPCD: WARN: MAX load reached: load 18.300000/10.000000 at i=1[12-20-2013 15:02:08] NPCD: WARN: MAX load reached: load 14.650000/10.000000 at i=1[12-20-2013 15:02:23] NPCD: WARN: MAX load reached: load 12.070000/10.000000 at i=1[12-20-2013 15:02:38] NPCD: WARN: MAX load reached: load 10.270000/10.000000 at i=1[01-06-2014 00:17:27] NPCD: WARN: MAX load reached: load 10.400000/10.000000 at i=0[01-06-2014 00:20:13] NPCD: WARN: MAX load reached: load 14.640000/10.000000 at i=0[01-06-2014 00:20:31] NPCD: WARN: MAX load reached: load 21.380000/10.000000 at i=1[01-06-2014 00:20:46] NPCD: WARN: MAX load reached: load 16.930000/10.000000 at i=1[01-06-2014 00:21:01] NPCD: WARN: MAX load reached: load 13.550000/10.000000 at i=1[01-06-2014 00:21:16] NPCD: WARN: MAX load reached: load 11.060000/10.000000 at i=1 

[lmiltchev]

You have quite many files in the "xidpe" directory. Is crond running?

Code: Select all

service crond status

Have you tried the solution, listed below (from our wiki page here: http://support.nagios.com/wiki/index.ph ... h_Problems )

If the file count is very large, run the following commands, which should restore regular performance graphing.

cd /usr/local/nagios/var/spool
rm -rf xidpe
mkdir xidpe
chown nagios.nagios xidpe
chmod 755 xidpe

Also, it seems like you've exceeded a few times the "load_threshold", defined in the "/usr/local/nagios/etc/pnp/npcd.cfg" file. What is your hardware like?

Code: Select all

lspci

If you have 2 cores, you can double the threshold of 10 to 20 (x2), it you have a quad core - to 40 (x4) and restart npcd:

Code: Select all

service npcd restart

Let me know if this helped.

[Bionic___]

crond is running
cleaned the xidpe directory, checked ownership, set permissions
Hardware is virtual instance with two cpu and 4GB allocated.
Set threshold to 20.
Restarted service.
BINGO! We have success. Thanks!

Is this a one-time sort of thing or is there some maintenance I should be doing?

[abrist]

This only happens when the nagios engine stops while performance data is still being recorded or npcd hits a load/timeout limit too often (passive checks can cause this as they may continue to get written to disk).
Do us one more favor and make sure that the spool folders are not filling back up:

Code: Select all

ls /usr/local/nagios/var/spool/xidpe/ | wc -l
ls /usr/local/nagios/var/spool/perfdata/ | wc -l

[Bionic___]

They were "2" and "2".

[abrist]

Great. You should be all set. You may want to monitor the number of files in those two folders as it will operate as an early warning system for perfdata/npcd issues.