Page 1 of 2

Performance graphs not displayed after the upgrade

Posted: Mon Aug 20, 2012 1:42 am
by fao
I've upgraded my Nagios server to the 2011R3.2 version using the source installer. Following the upgrade, all performance graphs can't be displayed.
What could be the cause and how to sort it out?
Thanks

tail -20 /usr/local/nagios/var/npcd.log

[08-19-2012 23:18:55] NPCD: ERROR: Executed command exits with return code '7'
[08-19-2012 23:18:55] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//service-perfdata.1345411124'
[08-19-2012 23:21:56] NPCD: ERROR: Executed command exits with return code '7'
[08-19-2012 23:21:56] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//service-perfdata.1345411304'
[08-19-2012 23:23:56] NPCD: ERROR: Executed command exits with return code '7'
[08-19-2012 23:23:56] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//service-perfdata.1345411424'
[08-19-2012 23:26:55] NPCD: ERROR: Executed command exits with return code '7'
[08-19-2012 23:26:55] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//service-perfdata.1345411604'
[08-20-2012 00:00:01] NPCD: Caught Termination Signal - Hasta la vista... baby
[08-20-2012 00:00:01] NPCD: npcd Daemon (0.4.14) started with PID=30175
[08-20-2012 00:00:01] NPCD: Please have a look at 'npcd -V' to get license information
[08-20-2012 00:00:01] NPCD: HINT: load_threshold is enabled - ('10.000000')
[08-20-2012 02:01:07] NPCD: ERROR: Executed command exits with return code '7'
[08-20-2012 02:01:07] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//host-perfdata.1345420859'
[08-20-2012 02:02:01] NPCD: ERROR: Executed command exits with return code '7'
[08-20-2012 02:02:01] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /usr/local/nagios/var/spool/perfdata//service-perfdata.1345420904'
[08-20-2012 06:00:01] NPCD: Caught Termination Signal - Hasta la vista... baby
[08-20-2012 06:00:01] NPCD: npcd Daemon (0.4.14) started with PID=27991
[08-20-2012 06:00:01] NPCD: Please have a look at 'npcd -V' to get license information
[08-20-2012 06:00:01] NPCD: HINT: load_threshold is enabled - ('10.000000')

tail -20 /usr/local/nagios/var/perfdata.log

2012-08-19 23:23:55 [30809] [0] *** Timeout while processing Host: "LTSAPP1" Service: "CPU_Stats"
2012-08-19 23:23:55 [30809] [0] *** process_perfdata.pl terminated on signal ALRM
2012-08-19 23:26:55 [3026] [0] *** TIMEOUT: Timeout after 5 secs. ***
2012-08-19 23:26:55 [3026] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2012-08-19 23:26:55 [3026] [0] *** TIMEOUT: Please check your npcd.cfg
2012-08-19 23:26:55 [3026] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//service-perfdata.1345411604-PID-3026 deleted
2012-08-19 23:26:55 [3026] [0] *** Timeout while processing Host: "HRAPPS1" Service: "Page_File_Usage"
2012-08-19 23:26:55 [3026] [0] *** process_perfdata.pl terminated on signal ALRM
2012-08-20 02:01:07 [19973] [0] *** TIMEOUT: Timeout after 5 secs. ***
2012-08-20 02:01:07 [19973] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2012-08-20 02:01:07 [19973] [0] *** TIMEOUT: Please check your npcd.cfg
2012-08-20 02:01:07 [19973] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//host-perfdata.1345420859-PID-19973 deleted
2012-08-20 02:01:07 [19973] [0] *** Timeout while processing Host: "KCEW-S07" Service: "_HOST_"
2012-08-20 02:01:07 [19973] [0] *** process_perfdata.pl terminated on signal ALRM
2012-08-20 02:02:01 [22060] [0] *** TIMEOUT: Timeout after 5 secs. ***
2012-08-20 02:02:01 [22060] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2012-08-20 02:02:01 [22060] [0] *** TIMEOUT: Please check your npcd.cfg
2012-08-20 02:02:01 [22060] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//service-perfdata.1345420904-PID-22060 deleted
2012-08-20 02:02:01 [22060] [0] *** Timeout while processing Host: "LPRAPP15" Service: "Swap_Usage"
2012-08-20 02:02:01 [22060] [0] *** process_perfdata.pl terminated on signal ALRM

Re: Performance graphs not displayed after the upgrade

Posted: Mon Aug 20, 2012 9:19 am
by scottwilkerson
We may have a backlog here, let modify the following file
/usr/local/nagios/etc/pnp/process_perfdata.cfg

Change the TIMEOUT to 15

See if new errors go away.

Re: Performance graphs not displayed after the upgrade

Posted: Mon Aug 20, 2012 9:32 am
by fao
This hasn't changed anything, we're still unable to get performance graphs.

Re: Performance graphs not displayed after the upgrade

Posted: Mon Aug 20, 2012 9:34 am
by scottwilkerson
Lets run the following procedure as this may be permissions related

http://assets.nagios.com/downloads/nagi ... ios_XI.pdf

If it still doesn't work, please post back the output of

Code: Select all

cat /etc/group | grep nag

Re: Performance graphs not displayed after the upgrade

Posted: Mon Aug 20, 2012 9:45 am
by fao
Fixing the permissions completed successfully, but didn't solve the issue.
Here is the output requested :

cat /etc/group | grep nag
nagios:x:500:nagios,apache
nagcmd:x:501:apache,nagios
nagioscmd:x:504:nagios

Re: Performance graphs not displayed after the upgrade

Posted: Mon Aug 20, 2012 9:55 am
by mguthrie
What are the permissions on /usr/local/nagios/libexec/process_perfdata.pl?

What version of Nagios XI are you using?

Re: Performance graphs not displayed after the upgrade

Posted: Tue Aug 21, 2012 2:38 am
by fao
ll /usr/local/nagios/libexec/process_perfdata.pl
-rwxr-xr-x 1 nagios nagios 42724 Aug 19 22:14 /usr/local/nagios/libexec/process_perfdata.pl

I've upgraded to 2011R3.2 version.
Does the upgrade require to redo the license activation process?

Re: Performance graphs not displayed after the upgrade

Posted: Tue Aug 21, 2012 9:18 am
by scottwilkerson
fao wrote: nagioscmd:x:504:nagios
Do you know how this group got added? This isn't in a standard XI install.

Also can you show the output of the following:

Code: Select all

ll /usr/local/nagios/var/spool/perfdata/
ls -ld /usr/local/nagios/var/spool/perfdata/
And can you attach your current /usr/local/nagios/etc/pnp/npcd.cfg

Thanks

Re: Performance graphs not displayed after the upgrade

Posted: Tue Aug 21, 2012 9:39 am
by fao
I can't remember when/why group nagioscmd has been added. I took over Nagios administration from a colleague some months ago.

ls -ld /usr/local/nagios/var/spool/perfdata/
drwxr-xr-x 2 nagios nagios 5181440 Aug 21 16:33 /usr/local/nagios/var/spool/perfdata/

Re: Performance graphs not displayed after the upgrade

Posted: Tue Aug 21, 2012 10:53 am
by lmiltchev
Run the following two commands and show us the output:

Code: Select all

ll /usr/local/nagios/share/perfdata
yum list installed bc