Page 4 of 4

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 11:50 am
by lmiltchev
The service ndo2db stop, does not stop the service. I need to do a kill on the pid to get it to stop.
I experienced the same issue on CentOS 7 and notified our developers about the problem. As soon as I hear back from them, I will update this post.

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 12:46 pm
by chicjo01
Finished the upgrade on one of the production servers. I then switched the traffic to go through the upgraded system. I also noticed that when I do service ndo2db status after 5 mins to 10 mins, I am seeing warning errors now. This error is also showing up in the /var/log/message

Has ndoutils-2.1.1 been through QA testing? Or was this not entended for Nagios XI, but just to be used with Nagios Core only?

Code: Select all

 service ndo2db status -l
Checking for ndo2db daemon...● ndo2db.service - LSB: Starts and stops the Nagios Data Out Daemon
   Loaded: loaded (/etc/rc.d/init.d/ndo2db)
   Active: active (running) since Wed 2016-09-21 12:52:41 EDT; 44min ago
     Docs: man:systemd-sysv-generator(8)
  Process: 63681 ExecStop=/etc/rc.d/init.d/ndo2db stop (code=exited, status=0/SUCCESS)
  Process: 65169 ExecStart=/etc/rc.d/init.d/ndo2db start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/ndo2db.service
           ├─65175 /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2...
           ├─66110 /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2...
           └─66111 /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2...

Sep 21 13:37:13 <Nagios Server> ndo2db[66110]: Message sent to queue.
Sep 21 13:37:13 <Nagios Server> ndo2db[66110]: Warning: queue send error, retr....
Sep 21 13:37:14 <Nagios Server> ndo2db[66110]: Message sent to queue.
Sep 21 13:37:14 <Nagios Server> ndo2db[66110]: Warning: queue send error, retr....
Sep 21 13:37:15 <Nagios Server> ndo2db[66110]: Message sent to queue.
Sep 21 13:37:15 <Nagios Server> ndo2db[66110]: Warning: queue send error, retr....
Sep 21 13:37:16 <Nagios Server> ndo2db[66110]: Message sent to queue.
Sep 21 13:37:16 <Nagios Server> ndo2db[66110]: Warning: queue send error, retr....
Sep 21 13:37:17 <Nagios Server> ndo2db[66110]: Message sent to queue.
Sep 21 13:37:17 <Nagios Server> ndo2db[66110]: Warning: queue send error, retr....
Hint: Some lines were ellipsized, use -l to show in full.

Code: Select all

ipcs

------ Message Queues --------
key        msqid      owner      perms      used-bytes   messages
0xb5010002 5865472    nagios     600        131030016    127959
0xb3010002 5898241    nagios     600        44247040     43210
0x5e010002 5931010    nagios     600        131053568    127982

------ Shared Memory Segments --------
key        shmid      owner      perms      bytes      nattch     status
0x01132235 3801088    root       600        1000       14

------ Semaphore Arrays --------
key        semid      owner      perms      nsems
0x00000000 1835008    apache     600        1
0x00000000 1867777    apache     600        1
0x00000000 1802242    apache     600        1
0x00000000 1900547    apache     600        1
0x00000000 1933316    apache     600        1
0x00000000 1966085    apache     600        1

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 1:00 pm
by chicjo01
I also found this in the /var/log/messages

Code: Select all

sh[145694]: rsync: link_stat "/usr/local/nagios/var/spool/perfdata/1474480574.perfdata.service-PID-129218" failed: No such file or directory (2)
Sep 21 13:56:32 <Nagios Server> ndo2db: Message sent to queue.
Sep 21 13:56:32 <Nagios Server> ndo2db: Warning: queue send error, retrying...
Sep 21 13:56:33 <Nagios Server> ndo2db: Message sent to queue.
Sep 21 13:56:33 <Nagios Server> ndo2db: Warning: queue send error, retrying...
Sep 21 13:56:33 <Nagios Server> sh[145694]: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9]

Code: Select all

 ps -ef | grep npcd
nagios    59521      1  0 13:33 ?        00:00:00 /usr/local/nagios/bin/npcd -d -f /usr/local/nagios/etc/pnp/npcd.cfg

Code: Select all

ls -l /usr/local/nagios/var/spool/ | wc -l
4

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 1:08 pm
by lmiltchev
Has ndoutils-2.1.1 been through QA testing? Or was this not entended for Nagios XI, but just to be used with Nagios Core only?
No, we are still testing it in Nagios XI. It should be ready for use in Nagios Core.

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 2:05 pm
by chicjo01
I am rolling back the changes, since the releases are not stable for Nagios XI. I switched the traffic back over to another production server. Do you know how long it will before they will be stable for Nagios XI? Please let me know when the upgrades are stable for production with Nagios XI.

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 2:24 pm
by chicjo01
You can close this, I will find a work-around until the next stable Nagios XI upgrade. Thank you.

Re: nagios_logentries causing problems

Posted: Wed Sep 21, 2016 2:40 pm
by lmiltchev
Closing.