Nagios Support Forum

Hello,

Suddenly npcd is not painting performance graphs.
+LOGs:
[root@a2nagio001p tmp]# tail -f /usr/local/nagios/var/npcd.log
[08-05-2020 06:53:34] NPCD: ERROR: Executed command exits with return code '7'
[08-05-2020 06:53:34] NPCD: ERROR: Command line was '/usr/local/nagios/libexec/process_perfdata.pl -n -b /var/nagiosramdisk/spool/perfdata//1596603182.perfdata.service'
[08-05-2020 15:04:26] NPCD: Caught Termination Signal - Hasta la vista... baby
[08-05-2020 15:09:54] NPCD: npcd Daemon (0.4.14) started with PID=10560
[08-05-2020 15:09:54] NPCD: Please have a look at 'npcd -V' to get license information
[08-05-2020 15:09:54] NPCD: HINT: load_threshold is enabled - ('50.000000')
[08-08-2020 11:40:44] NPCD: Error while getting file status[08-08-2020 19:01:59] NPCD: Caught Termination Signal - Hasta la vista... baby
[08-08-2020 19:01:59] NPCD: npcd Daemon (0.4.14) started with PID=24793
[08-08-2020 19:01:59] NPCD: Please have a look at 'npcd -V' to get license information
[08-08-2020 19:01:59] NPCD: HINT: load_threshold is enabled - ('50.000000')

[root@a2nagio001p tmp]# tail -f /usr/local/nagios/var/perfdata.log
2020-08-05 06:52:22 [11404] [0] *** TIMEOUT: Please check your npcd.cfg
2020-08-05 06:52:22 [11404] [0] *** TIMEOUT: /var/nagiosramdisk/spool/perfdata//1596603106.perfdata.service-PID-11404 deleted
2020-08-05 06:52:22 [11404] [0] *** Timeout while processing Host: "a2aqifx101p.fcc.intfcc.local" Service: "Drive_K__Disk_Usage"
2020-08-05 06:52:22 [11404] [0] *** process_perfdata.pl terminated on signal ALRM
2020-08-05 06:53:34 [22198] [0] *** TIMEOUT: Timeout after 20 secs. ***
2020-08-05 06:53:34 [22198] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2020-08-05 06:53:34 [22198] [0] *** TIMEOUT: Please check your npcd.cfg
2020-08-05 06:53:34 [22198] [0] *** TIMEOUT: /var/nagiosramdisk/spool/perfdata//1596603182.perfdata.service-PID-22198 deleted
2020-08-05 06:53:34 [22198] [0] *** Timeout while processing Host: "A2SPS011T.FCC.INTFCC.LOCAL" Service: "Template_ClusterWindows_EventLog_id_1197"
2020-08-05 06:53:34 [22198] [0] *** process_perfdata.pl terminated on signal ALRM

+Rest Files:
[root@a2nagio001p tmp]# ls /usr/local/nagios/var/spool/perfdata/ | wc -l
0
[root@a2nagio001p tmp]#

[root@a2nagio001p tmp]# ls /usr/local/nagios/var/spool/xidpe/ | wc -l
0
[root@a2nagio001p tmp]#

We increased de CPUs to 16
and restart the system:
[root@a2nagio001p tmp]# uptime
19:08:46 up 3 days, 3:59, 2 users, load average: 1.27, 1.37, 1.45
[root@a2nagio001p tmp]#

Any help?
Many Thanks in Advance

Configurations files:

[root@a2nagio001p ~]# grep -i timeout /usr/local/nagios/etc/pnp/process_perfdata.cfg
TIMEOUT = 20
[root@a2nagio001p ~]# cp /usr/local/nagios/etc/pnp/npcd.cfg /usr/local/nagios/etc/pnp/npcd.cfg.20200808
[root@a2nagio001p ~]# grep -i load /usr/local/nagios/etc/pnp/npcd.cfg
# use_load_threshold - enables/disables load watching
# use_load_threshold = <0 / 1> (default: 0)
#use_load_threshold = 0
# load_threshold - npcd won't start new threads
# if your system load is over this threshold
# load_threshold = <float value> (default: 10.0)
load_threshold = 50.0
[root@a2nagio001p ~]#

We have RAMDISK too

output:
[root@a2nagio001p ~]# systemctl status npcd.service
● npcd.service - LSB: Nagios NPCD Initscript
Loaded: loaded (/etc/rc.d/init.d/npcd; bad; vendor preset: disabled)
Active: active (running) since Sat 2020-08-08 21:43:08 CEST; 6min ago
Docs: man:systemd-sysv-generator(8)
Process: 44769 ExecStop=/etc/rc.d/init.d/npcd stop (code=exited, status=0/SUCCESS)
Process: 63841 ExecStart=/etc/rc.d/init.d/npcd start (code=exited, status=0/SUCCESS)
Main PID: 63844 (npcd)
CGroup: /system.slice/npcd.service
└─63844 /usr/local/nagios/bin/npcd -d -f /usr/local/nagios/etc/pnp/npcd.cfg

Aug 08 21:43:08 a2nagio001p.fcc.intfcc.local systemd[1]: Starting LSB: Nagios NPCD Initscript...
Aug 08 21:43:08 a2nagio001p.fcc.intfcc.local npcd[63841]: NPCD started.
Aug 08 21:43:08 a2nagio001p.fcc.intfcc.local systemd[1]: Failed to read PID from file /usr/local/nagiosxi/var/subsys/npcd.pid: Invalid argument
Aug 08 21:43:08 a2nagio001p.fcc.intfcc.local systemd[1]: Started LSB: Nagios NPCD Initscript.

After removind pid file
and
/etc/rc.d/init.d/npcd start

Continuous without painting

If I restart, Again problem with PID:

[root@a2nagio001p system]# systemctl status npcd
● npcd.service - LSB: Nagios NPCD Initscript
Loaded: loaded (/etc/rc.d/init.d/npcd; bad; vendor preset: disabled)
Active: active (running) since Sat 2020-08-08 22:41:09 CEST; 4s ago
Docs: man:systemd-sysv-generator(8)
Process: 67775 ExecStop=/etc/rc.d/init.d/npcd stop (code=exited, status=0/SUCCESS)
Process: 68458 ExecStart=/etc/rc.d/init.d/npcd start (code=exited, status=0/SUCCESS)
Main PID: 68461 (npcd)
CGroup: /system.slice/npcd.service
└─68461 /usr/local/nagios/bin/npcd -d -f /usr/local/nagios/etc/pnp/npcd.cfg

Aug 08 22:41:09 a2nagio001p.fcc.intfcc.local systemd[1]: Starting LSB: Nagios NPCD Initscript...
Aug 08 22:41:09 a2nagio001p.fcc.intfcc.local npcd[68458]: NPCD started.
Aug 08 22:41:09 a2nagio001p.fcc.intfcc.local systemd[1]: Failed to read PID from file /usr/local/nagiosxi/var/subsys/npcd.pid: Invalid argument
Aug 08 22:41:09 a2nagio001p.fcc.intfcc.local systemd[1]: Started LSB: Nagios NPCD Initscript.
[root@a2nagio001p system]#

In RAMDISK:
cd /var/nagiosramdisk/spool
[root@a2nagio001p spool]# find .
.
./perfdata
./xidpe
./checkresults

In /var/log/messages :
Aug 8 22:39:42 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:40:01 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:40:21 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:40:42 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:41:01 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:41:04 a2nagio001p systemd: Stopping LSB: Nagios NPCD Initscript...
Aug 8 22:41:04 a2nagio001p npcd: NPCD Stopped.
Aug 8 22:41:04 a2nagio001p systemd: Stopped LSB: Nagios NPCD Initscript.
Aug 8 22:41:09 a2nagio001p systemd: Starting LSB: Nagios NPCD Initscript...
Aug 8 22:41:09 a2nagio001p npcd: NPCD started.
Aug 8 22:41:09 a2nagio001p systemd: Failed to read PID from file /usr/local/nagiosxi/var/subsys/npcd.pid: Invalid argument
Aug 8 22:41:09 a2nagio001p systemd: Started LSB: Nagios NPCD Initscript.
Aug 8 22:41:22 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:41:42 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd
Aug 8 22:42:01 a2nagio001p sudo: nagios : TTY=unknown ; PWD=/home/nagios ; USER=root ; COMMAND=/usr/local/nagiosxi/scripts/manage_services.sh status npcd

I saw:

Happned too when system was rebooted:
https://support.nagios.com/forum/viewto ... 16&t=43554

Location missmatch:
[root@a2nagio001p spool]# ll /usr/local/pnp4nagios/var/host-perfdata
ls: cannot access /usr/local/pnp4nagios/var/host-perfdata: No such file or directory
[root@a2nagio001p spool]# ll /usr/local/pnp4nagios/var/service-perfdata
ls: cannot access /usr/local/pnp4nagios/var/service-perfdata: No such file or directory
[root@a2nagio001p spool]# ll /usr/local/nagios/var/host-perfdata
-rw-r--r-- 1 nagios nagios 27586 Jul 30 12:07 /usr/local/nagios/var/host-perfdata
[root@a2nagio001p spool]# ll /usr/local/nagios/var/service-perfdata
-rw-r--r-- 1 nagios nagios 1144563 Jul 30 12:07 /usr/local/nagios/var/service-perfdata