This support forum board is for support questions relating to
Nagios XI , our flagship commercial network monitoring solution.
JumpingSnake
Posts: 30 Joined: Thu Apr 19, 2012 9:19 am
Post
by JumpingSnake Wed Dec 04, 2013 2:06 pm
So I edited my check ram command to be the following:
Code: Select all
/usr/local/nagios/libexec/check_nrpe -H <IP of the test server> -t 30 -c CheckMEM -a MaxWarn=100% MaxCrit=101% ShowAll=long type=physical type=page type=virtual
and I get the following for output:
Code: Select all
OK: physical memory: Total: 192G - Used: 96.9G (50%) - Free: 95.1G (50%), page file: Total: 384G - Used: 97.7G (25%) - Free: 286G (75%), virtual memory: Total: 8T - Used: 279M (0%) - Free: 8T (100%)|'physical memory %'=50%;100;101 'physical memory'=96.88G;192;193.91;0;192 'page file %'=25%;100;101 'page file'=97.67G;383.99;387.83;0;383.99 'virtual memory %'=0%;100;101 'virtual memory'=278.8M;8388607.87;8472493.95;0;8388607.87
So it's returning the correct values of the RAM and it's usage, but this is what I see when I go to check any servers using this command:
Nagios.jpg
What's happening? Why does the command work, but the graphs not? Is it because of the values of 100 and 101?
You do not have the required permissions to view the files attached to this post.
sreinhardt
-fno-stack-protector
Posts: 4366 Joined: Mon Nov 19, 2012 12:10 pm
Post
by sreinhardt Wed Dec 04, 2013 2:19 pm
Is this also happening with your virtual_mem_% graphs? Did you change counter types, from non-% to %? I would not believe the 100 and 101 are causing an issue as they should just be warning\critical values for the graph.
Nagios-Plugins maintainer exclusively, unless you have other C language bugs with open-source nagios projects, then I am happy to help! Please pm or use other communication to alert me to issues as I no longer track the forum.
abrist
Red Shirt
Posts: 8334 Joined: Thu Nov 15, 2012 1:20 pm
Post
by abrist Wed Dec 04, 2013 2:19 pm
You may have changed the number of datasources which is not supported by rrds. Lets check the following logs:
Code: Select all
tail -25 /usr/local/nagios/var/perfdata.log
tail -25 /usr/local/nagios/var/npcd.logFormer Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the
Dark Side .
JumpingSnake
Posts: 30 Joined: Thu Apr 19, 2012 9:19 am
Post
by JumpingSnake Wed Dec 04, 2013 5:05 pm
sreinhardt - Yes, it's showing up for the virtual_mem_% as well. I don't believe that I've changed the type.
abrist -
perfdata.log
Code: Select all
2013-12-04 12:48:26 [32080] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 12:59:04 [9429] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 12:59:04 [9429] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 12:59:04 [9429] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 12:59:04 [9429] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386183517.perfdata.service-PID-9429 deleted
2013-12-04 12:59:04 [9429] [0] *** Timeout while processing Host: "<host1>" Service: "Disk_Usage"
2013-12-04 12:59:04 [9429] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 13:07:22 [17060] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 13:07:22 [17060] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 13:07:22 [17060] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 13:07:22 [17060] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386184027.perfdata.service-PID-17060 deleted
2013-12-04 13:07:22 [17060] [0] *** Timeout while processing Host: "<host2>" Service: "CPU"
2013-12-04 13:07:22 [17060] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386184687.perfdata.service-PID-27619 deleted
2013-12-04 13:18:27 [27619] [0] *** Timeout while processing Host: "<host3>" Service: "CPU"
2013-12-04 13:18:27 [27619] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386186217.perfdata.service-PID-18871 deleted
2013-12-04 13:44:03 [18871] [0] *** Timeout while processing Host: "<host4>" Service: "Dell_-_Check_OMSA"
2013-12-04 13:44:03 [18871] [0] *** process_perfdata.pl terminated on signal ALRM
npcd.log
Code: Select all
[12-04-2013 10:43:12] NPCD: WARN: MAX load reached: load 12.680000/10.000000 at i=0[12-04-2013 10:43:27] NPCD: WARN: MAX load reached: load 14.110000/10.000000 at i=1[12-04-2013 10:43:42] NPCD: WARN: MAX load reached: load 12.400000/10.000000 at i=1[12-04-2013 10:43:57] NPCD: WARN: MAX load reached: load 15.340000/10.000000 at i=1[12-04-2013 10:44:12] NPCD: WARN: MAX load reached: load 15.390000/10.000000 at i=1[12-04-2013 10:44:27] NPCD: WARN: MAX load reached: load 12.280000/10.000000 at i=1[12-04-2013 10:45:38] NPCD: WARN: MAX load reached: load 10.600000/10.000000 at i=0[12-04-2013 10:45:53] NPCD: WARN: MAX load reached: load 11.740000/10.000000 at i=1[12-04-2013 10:46:08] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=1[12-04-2013 10:46:23] NPCD: WARN: MAX load reached: load 10.390000/10.000000 at i=1[12-04-2013 10:47:02] NPCD: WARN: MAX load reached: load 10.010000/10.000000 at i=12[12-04-2013 10:57:54] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 10:57:54] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386176257.perfdata.service'
[12-04-2013 10:58:56] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[12-04-2013 10:59:11] NPCD: WARN: MAX load reached: load 10.050000/10.000000 at i=1[12-04-2013 11:01:26] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=0[12-04-2013 11:02:15] NPCD: WARN: MAX load reached: load 11.480000/10.000000 at i=0[12-04-2013 11:04:14] NPCD: WARN: MAX load reached: load 11.790000/10.000000 at i=0[12-04-2013 11:07:10] NPCD: WARN: MAX load reached: load 11.010000/10.000000 at i=0[12-04-2013 11:07:25] NPCD: WARN: MAX load reached: load 10.740000/10.000000 at i=1[12-04-2013 11:07:40] NPCD: WARN: MAX load reached: load 10.570000/10.000000 at i=1[12-04-2013 11:08:11] NPCD: WARN: MAX load reached: load 10.480000/10.000000 at i=0[12-04-2013 11:08:49] NPCD: WARN: MAX load reached: load 10.220000/10.000000 at i=0[12-04-2013 11:09:04] NPCD: WARN: MAX load reached: load 12.920000/10.000000 at i=1[12-04-2013 11:09:19] NPCD: WARN: MAX load reached: load 13.410000/10.000000 at i=1[12-04-2013 11:09:34] NPCD: WARN: MAX load reached: load 11.480000/10.000000 at i=1[12-04-2013 11:13:44] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 11:13:59] NPCD: WARN: MAX load reached: load 11.490000/10.000000 at i=1[12-04-2013 11:14:14] NPCD: WARN: MAX load reached: load 13.260000/10.000000 at i=1[12-04-2013 11:14:29] NPCD: WARN: MAX load reached: load 13.920000/10.000000 at i=1[12-04-2013 11:14:44] NPCD: WARN: MAX load reached: load 14.150000/10.000000 at i=1[12-04-2013 11:14:59] NPCD: WARN: MAX load reached: load 12.350000/10.000000 at i=1[12-04-2013 11:15:14] NPCD: WARN: MAX load reached: load 11.900000/10.000000 at i=1[12-04-2013 11:15:37] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:15:37] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386177218.perfdata.service'
[12-04-2013 11:15:57] NPCD: WARN: MAX load reached: load 11.120000/10.000000 at i=7[12-04-2013 11:16:12] NPCD: WARN: MAX load reached: load 12.870000/10.000000 at i=7[12-04-2013 11:16:27] NPCD: WARN: MAX load reached: load 11.070000/10.000000 at i=7[12-04-2013 11:16:42] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=7[12-04-2013 11:16:57] NPCD: WARN: MAX load reached: load 11.290000/10.000000 at i=7[12-04-2013 11:17:12] NPCD: WARN: MAX load reached: load 12.570000/10.000000 at i=7[12-04-2013 11:17:27] NPCD: WARN: MAX load reached: load 12.470000/10.000000 at i=7[12-04-2013 11:17:42] NPCD: WARN: MAX load reached: load 11.620000/10.000000 at i=7[12-04-2013 11:17:57] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=7[12-04-2013 11:18:40] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=12[12-04-2013 11:18:55] NPCD: WARN: MAX load reached: load 11.070000/10.000000 at i=12[12-04-2013 11:21:22] NPCD: WARN: MAX load reached: load 10.240000/10.000000 at i=0[12-04-2013 11:21:38] NPCD: WARN: MAX load reached: load 10.950000/10.000000 at i=1[12-04-2013 11:21:53] NPCD: WARN: MAX load reached: load 12.020000/10.000000 at i=1[12-04-2013 11:22:08] NPCD: WARN: MAX load reached: load 13.660000/10.000000 at i=1[12-04-2013 11:22:23] NPCD: WARN: MAX load reached: load 12.780000/10.000000 at i=1[12-04-2013 11:22:38] NPCD: WARN: MAX load reached: load 14.720000/10.000000 at i=1[12-04-2013 11:22:53] NPCD: WARN: MAX load reached: load 14.690000/10.000000 at i=1[12-04-2013 11:23:08] NPCD: WARN: MAX load reached: load 13.670000/10.000000 at i=1[12-04-2013 11:23:23] NPCD: WARN: MAX load reached: load 10.780000/10.000000 at i=1[12-04-2013 11:24:03] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:24:03] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386177727.perfdata.service'
[12-04-2013 11:24:03] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=12[12-04-2013 11:27:35] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:27:35] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178027.perfdata.service'
[12-04-2013 11:27:50] NPCD: WARN: MAX load reached: load 10.120000/10.000000 at i=0[12-04-2013 11:32:36] NPCD: WARN: MAX load reached: load 11.000000/10.000000 at i=0[12-04-2013 11:32:51] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=1[12-04-2013 11:33:06] NPCD: WARN: MAX load reached: load 12.730000/10.000000 at i=1[12-04-2013 11:33:21] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=1[12-04-2013 11:38:05] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:38:05] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178657.perfdata.service'
[12-04-2013 11:38:20] NPCD: WARN: MAX load reached: load 10.690000/10.000000 at i=0[12-04-2013 11:39:15] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 12:04:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:04:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386180217.perfdata.service'
[12-04-2013 12:18:35] NPCD: WARN: MAX load reached: load 10.350000/10.000000 at i=0[12-04-2013 12:18:50] NPCD: WARN: MAX load reached: load 11.720000/10.000000 at i=1[12-04-2013 12:19:05] NPCD: WARN: MAX load reached: load 10.460000/10.000000 at i=1[12-04-2013 12:24:23] NPCD: WARN: MAX load reached: load 12.520000/10.000000 at i=0[12-04-2013 12:24:38] NPCD: WARN: MAX load reached: load 13.840000/10.000000 at i=1[12-04-2013 12:24:53] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=1[12-04-2013 12:27:50] NPCD: WARN: MAX load reached: load 10.310000/10.000000 at i=0[12-04-2013 12:43:53] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=0[12-04-2013 12:44:09] NPCD: WARN: MAX load reached: load 13.210000/10.000000 at i=1[12-04-2013 12:44:24] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=1[12-04-2013 12:46:34] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:46:34] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182767.perfdata.service'
[12-04-2013 12:48:26] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:48:26] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182887.perfdata.service'
[12-04-2013 12:48:41] NPCD: WARN: MAX load reached: load 11.960000/10.000000 at i=0[12-04-2013 12:48:56] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=1[12-04-2013 12:49:11] NPCD: WARN: MAX load reached: load 12.080000/10.000000 at i=1[12-04-2013 12:49:26] NPCD: WARN: MAX load reached: load 10.640000/10.000000 at i=1[12-04-2013 12:49:41] NPCD: WARN: MAX load reached: load 11.570000/10.000000 at i=1[12-04-2013 12:59:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:59:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386183517.perfdata.service'
[12-04-2013 12:59:19] NPCD: WARN: MAX load reached: load 11.670000/10.000000 at i=0[12-04-2013 13:07:22] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:07:22] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184027.perfdata.service'
[12-04-2013 13:07:37] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=0[12-04-2013 13:18:27] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:18:27] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184687.perfdata.service'
[12-04-2013 13:18:42] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=0[12-04-2013 13:34:03] NPCD: WARN: MAX load reached: load 10.860000/10.000000 at i=0[12-04-2013 13:44:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:44:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386186217.perfdata.service'
[12-04-2013 13:44:19] NPCD: WARN: MAX load reached: load 10.400000/10.000000 at i=0[12-04-2013 13:56:18] NPCD: WARN: MAX load reached: load 11.220000/10.000000 at i=0[12-04-2013 13:56:33] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=1[12-04-2013 13:58:13] NPCD: WARN: MAX load reached: load 10.190000/10.000000 at i=0[12-04-2013 13:58:28] NPCD: WARN: MAX load reached: load 11.450000/10.000000 at i=1[12-04-2013 13:58:59] NPCD: WARN: MAX load reached: load 10.130000/10.000000 at i=0[12-04-2013 13:59:14] NPCD: WARN: MAX load reached: load 10.100000/10.000000 at i=1[12-04-2013 13:59:29] NPCD: WARN: MAX load reached: load 10.020000/10.000000 at i=1[root@MN-HOST-NAGXI-1 ~]# tail -25 /usr/local/nagios/var/npcd.log
[12-04-2013 10:43:12] NPCD: WARN: MAX load reached: load 12.680000/10.000000 at i=0[12-04-2013 10:43:27] NPCD: WARN: MAX load reached: load 14.110000/10.000000 at i=1[12-04-2013 10:43:42] NPCD: WARN: MAX load reached: load 12.400000/10.000000 at i=1[12-04-2013 10:43:57] NPCD: WARN: MAX load reached: load 15.340000/10.000000 at i=1[12-04-2013 10:44:12] NPCD: WARN: MAX load reached: load 15.390000/10.000000 at i=1[12-04-2013 10:44:27] NPCD: WARN: MAX load reached: load 12.280000/10.000000 at i=1[12-04-2013 10:45:38] NPCD: WARN: MAX load reached: load 10.600000/10.000000 at i=0[12-04-2013 10:45:53] NPCD: WARN: MAX load reached: load 11.740000/10.000000 at i=1[12-04-2013 10:46:08] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=1[12-04-2013 10:46:23] NPCD: WARN: MAX load reached: load 10.390000/10.000000 at i=1[12-04-2013 10:47:02] NPCD: WARN: MAX load reached: load 10.010000/10.000000 at i=12[12-04-2013 10:57:54] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 10:57:54] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386176257.perfdata.service'
[12-04-2013 10:58:56] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[12-04-2013 10:59:11] NPCD: WARN: MAX load reached: load 10.050000/10.000000 at i=1[12-04-2013 11:01:26] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=0[12-04-2013 11:02:15] NPCD: WARN: MAX load reached: load 11.480000/10.000000 at i=0[12-04-2013 11:04:14] NPCD: WARN: MAX load reached: load 11.790000/10.000000 at i=0[12-04-2013 11:07:10] NPCD: WARN: MAX load reached: load 11.010000/10.000000 at i=0[12-04-2013 11:07:25] NPCD: WARN: MAX load reached: load 10.740000/10.000000 at i=1[12-04-2013 11:07:40] NPCD: WARN: MAX load reached: load 10.570000/10.000000 at i=1[12-04-2013 11:08:11] NPCD: WARN: MAX load reached: load 10.480000/10.000000 at i=0[12-04-2013 11:08:49] NPCD: WARN: MAX load reached: load 10.220000/10.000000 at i=0[12-04-2013 11:09:04] NPCD: WARN: MAX load reached: load 12.920000/10.000000 at i=1[12-04-2013 11:09:19] NPCD: WARN: MAX load reached: load 13.410000/10.000000 at i=1[12-04-2013 11:09:34] NPCD: WARN: MAX load reached: load 11.480000/10.000000 at i=1[12-04-2013 11:13:44] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 11:13:59] NPCD: WARN: MAX load reached: load 11.490000/10.000000 at i=1[12-04-2013 11:14:14] NPCD: WARN: MAX load reached: load 13.260000/10.000000 at i=1[12-04-2013 11:14:29] NPCD: WARN: MAX load reached: load 13.920000/10.000000 at i=1[12-04-2013 11:14:44] NPCD: WARN: MAX load reached: load 14.150000/10.000000 at i=1[12-04-2013 11:14:59] NPCD: WARN: MAX load reached: load 12.350000/10.000000 at i=1[12-04-2013 11:15:14] NPCD: WARN: MAX load reached: load 11.900000/10.000000 at i=1[12-04-2013 11:15:37] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:15:37] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386177218.perfdata.service'
[12-04-2013 11:15:57] NPCD: WARN: MAX load reached: load 11.120000/10.000000 at i=7[12-04-2013 11:16:12] NPCD: WARN: MAX load reached: load 12.870000/10.000000 at i=7[12-04-2013 11:16:27] NPCD: WARN: MAX load reached: load 11.070000/10.000000 at i=7[12-04-2013 11:16:42] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=7[12-04-2013 11:16:57] NPCD: WARN: MAX load reached: load 11.290000/10.000000 at i=7[12-04-2013 11:17:12] NPCD: WARN: MAX load reached: load 12.570000/10.000000 at i=7[12-04-2013 11:17:27] NPCD: WARN: MAX load reached: load 12.470000/10.000000 at i=7[12-04-2013 11:17:42] NPCD: WARN: MAX load reached: load 11.620000/10.000000 at i=7[12-04-2013 11:17:57] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=7[12-04-2013 11:18:40] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=12[12-04-2013 11:18:55] NPCD: WARN: MAX load reached: load 11.070000/10.000000 at i=12[12-04-2013 11:21:22] NPCD: WARN: MAX load reached: load 10.240000/10.000000 at i=0[12-04-2013 11:21:38] NPCD: WARN: MAX load reached: load 10.950000/10.000000 at i=1[12-04-2013 11:21:53] NPCD: WARN: MAX load reached: load 12.020000/10.000000 at i=1[12-04-2013 11:22:08] NPCD: WARN: MAX load reached: load 13.660000/10.000000 at i=1[12-04-2013 11:22:23] NPCD: WARN: MAX load reached: load 12.780000/10.000000 at i=1[12-04-2013 11:22:38] NPCD: WARN: MAX load reached: load 14.720000/10.000000 at i=1[12-04-2013 11:22:53] NPCD: WARN: MAX load reached: load 14.690000/10.000000 at i=1[12-04-2013 11:23:08] NPCD: WARN: MAX load reached: load 13.670000/10.000000 at i=1[12-04-2013 11:23:23] NPCD: WARN: MAX load reached: load 10.780000/10.000000 at i=1[12-04-2013 11:24:03] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:24:03] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386177727.perfdata.service'
[12-04-2013 11:24:03] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=12[12-04-2013 11:27:35] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:27:35] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178027.perfdata.service'
[12-04-2013 11:27:50] NPCD: WARN: MAX load reached: load 10.120000/10.000000 at i=0[12-04-2013 11:32:36] NPCD: WARN: MAX load reached: load 11.000000/10.000000 at i=0[12-04-2013 11:32:51] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=1[12-04-2013 11:33:06] NPCD: WARN: MAX load reached: load 12.730000/10.000000 at i=1[12-04-2013 11:33:21] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=1[12-04-2013 11:38:05] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:38:05] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178657.perfdata.service'
[12-04-2013 11:38:20] NPCD: WARN: MAX load reached: load 10.690000/10.000000 at i=0[12-04-2013 11:39:15] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 12:04:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:04:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386180217.perfdata.service'
[12-04-2013 12:18:35] NPCD: WARN: MAX load reached: load 10.350000/10.000000 at i=0[12-04-2013 12:18:50] NPCD: WARN: MAX load reached: load 11.720000/10.000000 at i=1[12-04-2013 12:19:05] NPCD: WARN: MAX load reached: load 10.460000/10.000000 at i=1[12-04-2013 12:24:23] NPCD: WARN: MAX load reached: load 12.520000/10.000000 at i=0[12-04-2013 12:24:38] NPCD: WARN: MAX load reached: load 13.840000/10.000000 at i=1[12-04-2013 12:24:53] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=1[12-04-2013 12:27:50] NPCD: WARN: MAX load reached: load 10.310000/10.000000 at i=0[12-04-2013 12:43:53] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=0[12-04-2013 12:44:09] NPCD: WARN: MAX load reached: load 13.210000/10.000000 at i=1[12-04-2013 12:44:24] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=1[12-04-2013 12:46:34] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:46:34] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182767.perfdata.service'
[12-04-2013 12:48:26] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:48:26] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182887.perfdata.service'
[12-04-2013 12:48:41] NPCD: WARN: MAX load reached: load 11.960000/10.000000 at i=0[12-04-2013 12:48:56] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=1[12-04-2013 12:49:11] NPCD: WARN: MAX load reached: load 12.080000/10.000000 at i=1[12-04-2013 12:49:26] NPCD: WARN: MAX load reached: load 10.640000/10.000000 at i=1[12-04-2013 12:49:41] NPCD: WARN: MAX load reached: load 11.570000/10.000000 at i=1[12-04-2013 12:59:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:59:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386183517.perfdata.service'
[12-04-2013 12:59:19] NPCD: WARN: MAX load reached: load 11.670000/10.000000 at i=0[12-04-2013 13:07:22] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:07:22] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184027.perfdata.service'
[12-04-2013 13:07:37] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=0[12-04-2013 13:18:27] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:18:27] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184687.perfdata.service'
[12-04-2013 13:18:42] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=0[12-04-2013 13:34:03] NPCD: WARN: MAX load reached: load 10.860000/10.000000 at i=0[12-04-2013 13:44:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:44:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386186217.perfdata.service'
[12-04-2013 13:44:19] NPCD: WARN: MAX load reached: load 10.400000/10.000000 at i=0[12-04-2013 13:56:18] NPCD: WARN: MAX load reached: load 11.220000/10.000000 at i=0[12-04-2013 13:56:33] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=1[12-04-2013 13:58:13] NPCD: WARN: MAX load reached: load 10.190000/10.000000 at i=0[12-04-2013 13:58:28] NPCD: WARN: MAX load reached: load 11.450000/10.000000 at i=1[12-04-2013 13:58:59] NPCD: WARN: MAX load reached: load 10.130000/10.000000 at i=0[12-04-2013 13:59:14] NPCD: WARN: MAX load reached: load 10.100000/10.000000 at i=1[12-04-2013 13:59:29] NPCD: WARN: MAX load reached: load 10.020000/10.000000 at i=1[root@MN-HOST-NAGXI-1 ~]# cls
-bash: cls: command not found
[root@MN-HOST-NAGXI-1 ~]# clear
[root@MN-HOST-NAGXI-1 ~]# tail -25 /usr/local/nagios/var/npcd.log
[12-04-2013 10:43:12] NPCD: WARN: MAX load reached: load 12.680000/10.000000 at i=0[12-04-2013 10:43:27] NPCD: WARN: MAX load reached: load 14.110000/10.000000 at i=1[12-04-2013 10:43:42] NPCD: WARN: MAX load reached: load 12.400000/10.000000 at i=1[12-04-2013 10:43:57] NPCD: WARN: MAX load reached: load 15.340000/10.000000 at i=1[12-04-2013 10:44:12] NPCD: WARN: MAX load reached: load 15.390000/10.000000 at i=1[12-04-2013 10:44:27] NPCD: WARN: MAX load reached: load 12.280000/10.000000 at i=1[12-04-2013 10:45:38] NPCD: WARN: MAX load reached: load 10.600000/10.000000 at i=0[12-04-2013 10:45:53] NPCD: WARN: MAX load reached: load 11.740000/10.000000 at i=1[12-04-2013 10:46:08] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=1[12-04-2013 10:46:23] NPCD: WARN: MAX load reached: load 10.390000/10.000000 at i=1[12-04-2013 10:47:02] NPCD: WARN: MAX load reached: load 10.010000/10.000000 at i=12[12-04-2013 10:57:54] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 10:57:54] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386176257.perfdata.service'
[12-04-2013 10:58:56] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=0[12-04-2013 10:59:11] NPCD: WARN: MAX load reached: load 10.050000/10.000000 at i=1[12-04-2013 11:01:26] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=0[12-04-2013 11:02:15] NPCD: WARN: MAX load reached: load 11.480000/10.000000 at i=0[12-04-2013 11:04:14] NPCD: WARN: MAX load reached: load 11.790000/10.000000 at i=0[12-04-2013 11:07:10] NPCD: WARN: MAX load reached: load 11.010000/10.000000 at i=0[12-04-2013 11:07:25] NPCD: WARN: MAX load reached: load 10.740000/10.000000 at i=1[12-04-2013 11:07:40] NPCD: WARN: MAX load reached: load 10.570000/10.000000 at i=1[12-04-2013 11:08:11] NPCD: WARN: MAX load reached: load 10.480000/10.000000 at i=0[12-04-2013 11:08:49] NPCD: WARN: MAX load reached: load 10.220000/10.000000 at i=0[12-04-2013 11:09:04] NPCD: WARN: MAX load reached: load 12.920000/10.000000 at i=1[12-04-2013 11:09:19] NPCD: WARN: MAX load reached: load 13.410000/10.000000 at i=1[12-04-2013 11:09:34] NPCD: WARN: MAX load reached: load 11.480000/10.000000 at i=1[12-04-2013 11:13:44] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 11:13:59] NPCD: WARN: MAX load reached: load 11.490000/10.000000 at i=1[12-04-2013 11:14:14] NPCD: WARN: MAX load reached: load 13.260000/10.000000 at i=1[12-04-2013 11:14:29] NPCD: WARN: MAX load reached: load 13.920000/10.000000 at i=1[12-04-2013 11:14:44] NPCD: WARN: MAX load reached: load 14.150000/10.000000 at i=1[12-04-2013 11:14:59] NPCD: WARN: MAX load reached: load 12.350000/10.000000 at i=1[12-04-2013 11:15:14] NPCD: WARN: MAX load reached: load 11.900000/10.000000 at i=1[12-04-2013 11:15:37] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:15:37] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386177218.perfdata.service'
[12-04-2013 11:15:57] NPCD: WARN: MAX load reached: load 11.120000/10.000000 at i=7[12-04-2013 11:16:12] NPCD: WARN: MAX load reached: load 12.870000/10.000000 at i=7[12-04-2013 11:16:27] NPCD: WARN: MAX load reached: load 11.070000/10.000000 at i=7[12-04-2013 11:16:42] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=7[12-04-2013 11:16:57] NPCD: WARN: MAX load reached: load 11.290000/10.000000 at i=7[12-04-2013 11:17:12] NPCD: WARN: MAX load reached: load 12.570000/10.000000 at i=7[12-04-2013 11:17:27] NPCD: WARN: MAX load reached: load 12.470000/10.000000 at i=7[12-04-2013 11:17:42] NPCD: WARN: MAX load reached: load 11.620000/10.000000 at i=7[12-04-2013 11:17:57] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=7[12-04-2013 11:18:40] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=12[12-04-2013 11:18:55] NPCD: WARN: MAX load reached: load 11.070000/10.000000 at i=12[12-04-2013 11:21:22] NPCD: WARN: MAX load reached: load 10.240000/10.000000 at i=0[12-04-2013 11:21:38] NPCD: WARN: MAX load reached: load 10.950000/10.000000 at i=1[12-04-2013 11:21:53] NPCD: WARN: MAX load reached: load 12.020000/10.000000 at i=1[12-04-2013 11:22:08] NPCD: WARN: MAX load reached: load 13.660000/10.000000 at i=1[12-04-2013 11:22:23] NPCD: WARN: MAX load reached: load 12.780000/10.000000 at i=1[12-04-2013 11:22:38] NPCD: WARN: MAX load reached: load 14.720000/10.000000 at i=1[12-04-2013 11:22:53] NPCD: WARN: MAX load reached: load 14.690000/10.000000 at i=1[12-04-2013 11:23:08] NPCD: WARN: MAX load reached: load 13.670000/10.000000 at i=1[12-04-2013 11:23:23] NPCD: WARN: MAX load reached: load 10.780000/10.000000 at i=1[12-04-2013 11:24:03] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:24:03] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386177727.perfdata.service'
[12-04-2013 11:24:03] NPCD: WARN: MAX load reached: load 10.720000/10.000000 at i=12[12-04-2013 11:27:35] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:27:35] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178027.perfdata.service'
[12-04-2013 11:27:50] NPCD: WARN: MAX load reached: load 10.120000/10.000000 at i=0[12-04-2013 11:32:36] NPCD: WARN: MAX load reached: load 11.000000/10.000000 at i=0[12-04-2013 11:32:51] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=1[12-04-2013 11:33:06] NPCD: WARN: MAX load reached: load 12.730000/10.000000 at i=1[12-04-2013 11:33:21] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=1[12-04-2013 11:38:05] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:38:05] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178657.perfdata.service'
[12-04-2013 11:38:20] NPCD: WARN: MAX load reached: load 10.690000/10.000000 at i=0[12-04-2013 11:39:15] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 12:04:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:04:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386180217.perfdata.service'
[12-04-2013 12:18:35] NPCD: WARN: MAX load reached: load 10.350000/10.000000 at i=0[12-04-2013 12:18:50] NPCD: WARN: MAX load reached: load 11.720000/10.000000 at i=1[12-04-2013 12:19:05] NPCD: WARN: MAX load reached: load 10.460000/10.000000 at i=1[12-04-2013 12:24:23] NPCD: WARN: MAX load reached: load 12.520000/10.000000 at i=0[12-04-2013 12:24:38] NPCD: WARN: MAX load reached: load 13.840000/10.000000 at i=1[12-04-2013 12:24:53] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=1[12-04-2013 12:27:50] NPCD: WARN: MAX load reached: load 10.310000/10.000000 at i=0[12-04-2013 12:43:53] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=0[12-04-2013 12:44:09] NPCD: WARN: MAX load reached: load 13.210000/10.000000 at i=1[12-04-2013 12:44:24] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=1[12-04-2013 12:46:34] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:46:34] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182767.perfdata.service'
[12-04-2013 12:48:26] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:48:26] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182887.perfdata.service'
[12-04-2013 12:48:41] NPCD: WARN: MAX load reached: load 11.960000/10.000000 at i=0[12-04-2013 12:48:56] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=1[12-04-2013 12:49:11] NPCD: WARN: MAX load reached: load 12.080000/10.000000 at i=1[12-04-2013 12:49:26] NPCD: WARN: MAX load reached: load 10.640000/10.000000 at i=1[12-04-2013 12:49:41] NPCD: WARN: MAX load reached: load 11.570000/10.000000 at i=1[12-04-2013 12:59:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:59:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386183517.perfdata.service'
[12-04-2013 12:59:19] NPCD: WARN: MAX load reached: load 11.670000/10.000000 at i=0[12-04-2013 13:07:22] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:07:22] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184027.perfdata.service'
[12-04-2013 13:07:37] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=0[12-04-2013 13:18:27] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:18:27] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184687.perfdata.service'
[12-04-2013 13:18:42] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=0[12-04-2013 13:34:03] NPCD: WARN: MAX load reached: load 10.860000/10.000000 at i=0[12-04-2013 13:44:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:44:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386186217.perfdata.service'
[12-04-2013 13:44:19] NPCD: WARN: MAX load reached: load 10.400000/10.000000 at i=0[12-04-2013 13:56:18] NPCD: WARN: MAX load reached: load 11.220000/10.000000 at i=0[12-04-2013 13:56:33] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=1[12-04-2013 13:58:13] NPCD: WARN: MAX load reached: load 10.190000/10.000000 at i=0[12-04-2013 13:58:28] NPCD: WARN: MAX load reached: load 11.450000/10.000000 at i=1[12-04-2013 13:58:59] NPCD: WARN: MAX load reached: load 10.130000/10.000000 at i=0[12-04-2013 13:59:14] NPCD: WARN: MAX load reached: load 10.100000/10.000000 at i=1[12-04-2013 13:59:29] NPCD: WARN: MAX load reached: load 10.020000/10.000000 at i=1
Would anything else help?
abrist
Red Shirt
Posts: 8334 Joined: Thu Nov 15, 2012 1:20 pm
Post
by abrist Wed Dec 04, 2013 5:28 pm
Alright. You are experiencing a rather common issue. You need to increase the timeout and load thresholds for the performance data reaper.
Edit the following file:
Code: Select all
/usr/local/nagios/etc/pnp/process_perfdata.cfg
Change:
To:
Also edit this file:
Code: Select all
/usr/local/nagios/etc/pnp/npcd.cfg
Change:
To:
Now restart npcd:
Code: Select all
service npcd stop
killall -9 npcd
service npcd startFormer Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the
Dark Side .
JumpingSnake
Posts: 30 Joined: Thu Apr 19, 2012 9:19 am
Post
by JumpingSnake Wed Dec 04, 2013 6:11 pm
I made the two changes and then restarted the service, but I still see the same results in the performance graph. Does it usually take more than 30 min to catch back up?
abrist
Red Shirt
Posts: 8334 Joined: Thu Nov 15, 2012 1:20 pm
Post
by abrist Thu Dec 05, 2013 10:38 am
It may take even longer as it has to work through the backlog. Can you check the logs once again and post the output here?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the
Dark Side .
JumpingSnake
Posts: 30 Joined: Thu Apr 19, 2012 9:19 am
Post
by JumpingSnake Thu Dec 05, 2013 11:58 am
I just checked again this morning, still nan. The server "feels" much faster after rebooting the service yesterday, so that's good at least
Here are the logs again:
perfdata.log:
Code: Select all
2013-12-04 13:07:22 [17060] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 13:18:27 [27619] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386184687.perfdata.service-PID-27619 deleted
2013-12-04 13:18:27 [27619] [0] *** Timeout while processing Host: "<host1>" Service: "CPU"
2013-12-04 13:18:27 [27619] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 13:44:03 [18871] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386186217.perfdata.service-PID-18871 deleted
2013-12-04 13:44:03 [18871] [0] *** Timeout while processing Host: "<host2>" Service: "Dell_-_Check_OMSA"
2013-12-04 13:44:03 [18871] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 14:04:02 [5077] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 14:04:02 [5077] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 14:04:02 [5077] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 14:04:02 [5077] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386187417.perfdata.service-PID-5077 deleted
2013-12-04 14:04:02 [5077] [0] *** Timeout while processing Host: "<host3>" Service: "Disk_Usage"
2013-12-04 14:04:02 [5077] [0] *** process_perfdata.pl terminated on signal ALRM
2013-12-04 14:17:55 [17835] [0] *** TIMEOUT: Timeout after 5 secs. ***
2013-12-04 14:17:55 [17835] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2013-12-04 14:17:55 [17835] [0] *** TIMEOUT: Please check your npcd.cfg
2013-12-04 14:17:55 [17835] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1386188257.perfdata.service-PID-17835 deleted
2013-12-04 14:17:55 [17835] [0] *** Timeout while processing Host: "<host4>" Service: "Disk_Usage"
2013-12-04 14:17:55 [17835] [0] *** process_perfdata.pl terminated on signal ALRM
npcd.log:
Code: Select all
[12-04-2013 11:27:35] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178027.perfdata.service'
[12-04-2013 11:27:50] NPCD: WARN: MAX load reached: load 10.120000/10.000000 at i=0[12-04-2013 11:32:36] NPCD: WARN: MAX load reached: load 11.000000/10.000000 at i=0[12-04-2013 11:32:51] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=1[12-04-2013 11:33:06] NPCD: WARN: MAX load reached: load 12.730000/10.000000 at i=1[12-04-2013 11:33:21] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=1[12-04-2013 11:38:05] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 11:38:05] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386178657.perfdata.service'
[12-04-2013 11:38:20] NPCD: WARN: MAX load reached: load 10.690000/10.000000 at i=0[12-04-2013 11:39:15] NPCD: WARN: MAX load reached: load 10.170000/10.000000 at i=0[12-04-2013 12:04:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:04:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386180217.perfdata.service'
[12-04-2013 12:18:35] NPCD: WARN: MAX load reached: load 10.350000/10.000000 at i=0[12-04-2013 12:18:50] NPCD: WARN: MAX load reached: load 11.720000/10.000000 at i=1[12-04-2013 12:19:05] NPCD: WARN: MAX load reached: load 10.460000/10.000000 at i=1[12-04-2013 12:24:23] NPCD: WARN: MAX load reached: load 12.520000/10.000000 at i=0[12-04-2013 12:24:38] NPCD: WARN: MAX load reached: load 13.840000/10.000000 at i=1[12-04-2013 12:24:53] NPCD: WARN: MAX load reached: load 11.350000/10.000000 at i=1[12-04-2013 12:27:50] NPCD: WARN: MAX load reached: load 10.310000/10.000000 at i=0[12-04-2013 12:43:53] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=0[12-04-2013 12:44:09] NPCD: WARN: MAX load reached: load 13.210000/10.000000 at i=1[12-04-2013 12:44:24] NPCD: WARN: MAX load reached: load 11.310000/10.000000 at i=1[12-04-2013 12:46:34] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:46:34] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182767.perfdata.service'
[12-04-2013 12:48:26] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:48:26] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386182887.perfdata.service'
[12-04-2013 12:48:41] NPCD: WARN: MAX load reached: load 11.960000/10.000000 at i=0[12-04-2013 12:48:56] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=1[12-04-2013 12:49:11] NPCD: WARN: MAX load reached: load 12.080000/10.000000 at i=1[12-04-2013 12:49:26] NPCD: WARN: MAX load reached: load 10.640000/10.000000 at i=1[12-04-2013 12:49:41] NPCD: WARN: MAX load reached: load 11.570000/10.000000 at i=1[12-04-2013 12:59:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 12:59:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386183517.perfdata.service'
[12-04-2013 12:59:19] NPCD: WARN: MAX load reached: load 11.670000/10.000000 at i=0[12-04-2013 13:07:22] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:07:22] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184027.perfdata.service'
[12-04-2013 13:07:37] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=0[12-04-2013 13:18:27] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:18:27] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386184687.perfdata.service'
[12-04-2013 13:18:42] NPCD: WARN: MAX load reached: load 10.900000/10.000000 at i=0[12-04-2013 13:34:03] NPCD: WARN: MAX load reached: load 10.860000/10.000000 at i=0[12-04-2013 13:44:04] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 13:44:04] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386186217.perfdata.service'
[12-04-2013 13:44:19] NPCD: WARN: MAX load reached: load 10.400000/10.000000 at i=0[12-04-2013 13:56:18] NPCD: WARN: MAX load reached: load 11.220000/10.000000 at i=0[12-04-2013 13:56:33] NPCD: WARN: MAX load reached: load 10.090000/10.000000 at i=1[12-04-2013 13:58:13] NPCD: WARN: MAX load reached: load 10.190000/10.000000 at i=0[12-04-2013 13:58:28] NPCD: WARN: MAX load reached: load 11.450000/10.000000 at i=1[12-04-2013 13:58:59] NPCD: WARN: MAX load reached: load 10.130000/10.000000 at i=0[12-04-2013 13:59:14] NPCD: WARN: MAX load reached: load 10.100000/10.000000 at i=1[12-04-2013 13:59:29] NPCD: WARN: MAX load reached: load 10.020000/10.000000 at i=1[12-04-2013 14:04:03] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 14:04:03] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386187417.perfdata.service'
[12-04-2013 14:04:18] NPCD: WARN: MAX load reached: load 12.230000/10.000000 at i=0[12-04-2013 14:04:33] NPCD: WARN: MAX load reached: load 13.490000/10.000000 at i=1[12-04-2013 14:04:48] NPCD: WARN: MAX load reached: load 11.220000/10.000000 at i=1[12-04-2013 14:07:15] NPCD: WARN: MAX load reached: load 10.290000/10.000000 at i=0[12-04-2013 14:07:30] NPCD: WARN: MAX load reached: load 10.760000/10.000000 at i=1[12-04-2013 14:07:45] NPCD: WARN: MAX load reached: load 10.370000/10.000000 at i=1[12-04-2013 14:08:00] NPCD: WARN: MAX load reached: load 11.550000/10.000000 at i=1[12-04-2013 14:08:15] NPCD: WARN: MAX load reached: load 11.190000/10.000000 at i=1[12-04-2013 14:08:30] NPCD: WARN: MAX load reached: load 12.350000/10.000000 at i=1[12-04-2013 14:13:22] NPCD: WARN: MAX load reached: load 11.020000/10.000000 at i=0[12-04-2013 14:13:37] NPCD: WARN: MAX load reached: load 11.360000/10.000000 at i=1[12-04-2013 14:13:52] NPCD: WARN: MAX load reached: load 10.810000/10.000000 at i=1[12-04-2013 14:17:55] NPCD: ERROR: Executed command exits with return code '7'
[12-04-2013 14:17:55] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//1386188257.perfdata.service'
[12-04-2013 14:18:10] NPCD: WARN: MAX load reached: load 10.640000/10.000000 at i=0[12-04-2013 14:18:25] NPCD: WARN: MAX load reached: load 11.600000/10.000000 at i=1[12-04-2013 14:18:40] NPCD: WARN: MAX load reached: load 11.560000/10.000000 at i=1[12-04-2013 14:18:55] NPCD: WARN: MAX load reached: load 10.430000/10.000000 at i=1[12-04-2013 14:31:55] NPCD: Caught Termination Signal - Hasta la vista... baby
[12-04-2013 14:32:21] NPCD: npcd Daemon (0.4.14) started with PID=31023
[12-04-2013 14:32:21] NPCD: Please have a look at 'npcd -V' to get license information
[12-04-2013 14:32:21] NPCD: HINT: load_threshold is enabled - ('30.000000')
Are your thoughts that I need to set the values you had me change to an even higher number?
abrist
Red Shirt
Posts: 8334 Joined: Thu Nov 15, 2012 1:20 pm
Post
by abrist Thu Dec 05, 2013 12:04 pm
JumpingSnake wrote: Are your thoughts that I need to set the values you had me change to an even higher number?
Nope, all those error are from yesterday. I presume you still do not have graphing working though?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the
Dark Side .
JumpingSnake
Posts: 30 Joined: Thu Apr 19, 2012 9:19 am
Post
by JumpingSnake Thu Dec 05, 2013 12:07 pm
Correct, still no numbers for those graphs as of yet.
Here are the logs again: