Page 1 of 1
No rrd files being created
Posted: Thu Jan 09, 2014 11:08 am
by Bionic___
Although I have enabled performance data on all of my hosts and some of my services, I cannot get performance graphs. I checked the server and there are no rrd files being created. I have upgraded, checked the help at
http://support.nagios.com/wiki/index.ph ... h_Problems but it does not seem to have anything that addresses the failure to create rrd files. I am not sure where to go next.
Re: No rrd files being created
Posted: Thu Jan 09, 2014 11:13 am
by slansing
Can you show the output of the following:
Code: Select all
service npcd status
ls /usr/local/nagios/var/spool/xidpe/ | wc -l
ls /usr/local/nagios/var/spool/perfdata/ | wc -l
tail -50 /usr/local/nagios/var/npcd.log
Re: No rrd files being created
Posted: Thu Jan 09, 2014 11:38 am
by Bionic___
slansing wrote:Can you show the output of the following:
Code: Select all
service npcd status
ls /usr/local/nagios/var/spool/xidpe/ | wc -l
ls /usr/local/nagios/var/spool/perfdata/ | wc -l
tail -50 /usr/local/nagios/var/npcd.log
service npcd status
result="NPCD running"
ls /usr/local/nagios/var/spool/xidpe/ | wc -l
result="818215" when run a few seconds later it was "818219"
ls /usr/local/nagios/var/spool/perfdata/ | wc -l
result="0"
tail -50 /usr/local/nagios/var/npcd.log
result in following code block:
Code: Select all
[10-30-2013 09:44:43] NPCD: npcd Daemon (0.4.14) started with PID=32200
[10-30-2013 09:44:43] NPCD: Please have a look at 'npcd -V' to get license information
[10-30-2013 09:44:43] NPCD: HINT: load_threshold is enabled - ('10.000000')
[10-30-2013 13:01:57] NPCD: Caught Termination Signal - Hasta la vista... baby
[10-30-2013 13:05:37] NPCD: npcd Daemon (0.4.14) started with PID=2868
[10-30-2013 13:05:37] NPCD: Please have a look at 'npcd -V' to get license information
[10-30-2013 13:05:37] NPCD: HINT: load_threshold is enabled - ('10.000000')
[11-02-2013 11:12:38] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=0[11-04-2013 14:08:20] NPCD: Caught Termination Signal - Hasta la vista... baby
[11-04-2013 14:12:02] NPCD: npcd Daemon (0.4.14) started with PID=2889
[11-04-2013 14:12:02] NPCD: Please have a look at 'npcd -V' to get license information
[11-04-2013 14:12:02] NPCD: HINT: load_threshold is enabled - ('10.000000')
[11-13-2013 16:02:45] NPCD: WARN: MAX load reached: load 11.080000/10.000000 at i=0[11-13-2013 16:03:01] NPCD: WARN: MAX load reached: load 10.380000/10.000000 at i=1[11-13-2013 16:17:39] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[11-13-2013 16:36:37] NPCD: WARN: MAX load reached: load 10.610000/10.000000 at i=0[11-13-2013 16:36:59] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=1[11-13-2013 16:38:33] NPCD: WARN: MAX load reached: load 10.290000/10.000000 at i=0[11-13-2013 16:43:18] NPCD: WARN: MAX load reached: load 11.400000/10.000000 at i=0[11-13-2013 16:43:37] NPCD: WARN: MAX load reached: load 12.350000/10.000000 at i=1[11-13-2013 16:43:52] NPCD: WARN: MAX load reached: load 11.120000/10.000000 at i=1[11-13-2013 16:44:07] NPCD: WARN: MAX load reached: load 10.560000/10.000000 at i=1[11-13-2013 16:49:27] NPCD: WARN: MAX load reached: load 10.470000/10.000000 at i=0[11-13-2013 16:50:46] NPCD: WARN: MAX load reached: load 10.490000/10.000000 at i=0[12-17-2013 14:26:23] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[12-17-2013 14:30:10] NPCD: WARN: MAX load reached: load 10.260000/10.000000 at i=0[12-17-2013 14:30:25] NPCD: WARN: MAX load reached: load 11.570000/10.000000 at i=1[12-17-2013 14:31:12] NPCD: WARN: MAX load reached: load 12.910000/10.000000 at i=0[12-17-2013 14:31:27] NPCD: WARN: MAX load reached: load 22.440000/10.000000 at i=1[12-17-2013 14:31:42] NPCD: WARN: MAX load reached: load 20.350000/10.000000 at i=1[12-17-2013 14:31:57] NPCD: WARN: MAX load reached: load 16.740000/10.000000 at i=1[12-17-2013 14:32:12] NPCD: WARN: MAX load reached: load 17.470000/10.000000 at i=1[12-17-2013 14:32:27] NPCD: WARN: MAX load reached: load 17.110000/10.000000 at i=1[12-17-2013 14:32:43] NPCD: WARN: MAX load reached: load 16.890000/10.000000 at i=1[12-17-2013 14:32:58] NPCD: WARN: MAX load reached: load 22.800000/10.000000 at i=1[12-17-2013 14:33:14] NPCD: WARN: MAX load reached: load 27.640000/10.000000 at i=1[12-17-2013 14:33:29] NPCD: WARN: MAX load reached: load 23.150000/10.000000 at i=1[12-17-2013 14:33:44] NPCD: WARN: MAX load reached: load 18.380000/10.000000 at i=1[12-17-2013 14:33:59] NPCD: WARN: MAX load reached: load 14.540000/10.000000 at i=1[12-17-2013 14:34:14] NPCD: WARN: MAX load reached: load 11.920000/10.000000 at i=1[12-20-2013 15:01:38] NPCD: WARN: MAX load reached: load 10.420000/10.000000 at i=0[12-20-2013 15:01:53] NPCD: WARN: MAX load reached: load 18.300000/10.000000 at i=1[12-20-2013 15:02:08] NPCD: WARN: MAX load reached: load 14.650000/10.000000 at i=1[12-20-2013 15:02:23] NPCD: WARN: MAX load reached: load 12.070000/10.000000 at i=1[12-20-2013 15:02:38] NPCD: WARN: MAX load reached: load 10.270000/10.000000 at i=1[01-06-2014 00:17:27] NPCD: WARN: MAX load reached: load 10.400000/10.000000 at i=0[01-06-2014 00:20:13] NPCD: WARN: MAX load reached: load 14.640000/10.000000 at i=0[01-06-2014 00:20:31] NPCD: WARN: MAX load reached: load 21.380000/10.000000 at i=1[01-06-2014 00:20:46] NPCD: WARN: MAX load reached: load 16.930000/10.000000 at i=1[01-06-2014 00:21:01] NPCD: WARN: MAX load reached: load 13.550000/10.000000 at i=1[01-06-2014 00:21:16] NPCD: WARN: MAX load reached: load 11.060000/10.000000 at i=1
Re: No rrd files being created
Posted: Thu Jan 09, 2014 12:26 pm
by lmiltchev
You have quite many files in the "xidpe" directory. Is crond running?
Have you tried the solution, listed below (from our wiki page here:
http://support.nagios.com/wiki/index.ph ... h_Problems )
If the file count is very large, run the following commands, which should restore regular performance graphing.
cd /usr/local/nagios/var/spool
rm -rf xidpe
mkdir xidpe
chown nagios.nagios xidpe
chmod 755 xidpe
Also, it seems like you've exceeded a few times the "load_threshold", defined in the "/usr/local/nagios/etc/pnp/npcd.cfg" file. What is your hardware like?
If you have 2 cores, you can double the threshold of 10 to 20 (x2), it you have a quad core - to 40 (x4) and restart npcd:
Let me know if this helped.
Re: No rrd files being created
Posted: Thu Jan 09, 2014 1:35 pm
by Bionic___
crond is running
cleaned the xidpe directory, checked ownership, set permissions
Hardware is virtual instance with two cpu and 4GB allocated.
Set threshold to 20.
Restarted service.
BINGO! We have success. Thanks!
Is this a one-time sort of thing or is there some maintenance I should be doing?
Re: No rrd files being created
Posted: Thu Jan 09, 2014 1:42 pm
by abrist
This only happens when the nagios engine stops while performance data is still being recorded or npcd hits a load/timeout limit too often (passive checks can cause this as they may continue to get written to disk).
Do us one more favor and make sure that the spool folders are not filling back up:
Code: Select all
ls /usr/local/nagios/var/spool/xidpe/ | wc -l
ls /usr/local/nagios/var/spool/perfdata/ | wc -l
Re: No rrd files being created
Posted: Thu Jan 09, 2014 2:13 pm
by Bionic___
They were "2" and "2".
Re: No rrd files being created
Posted: Thu Jan 09, 2014 2:16 pm
by abrist
Great. You should be all set. You may want to monitor the number of files in those two folders as it will operate as an early warning system for perfdata/npcd issues.