Page 1 of 2

Host Status not Updating

Posted: Thu May 07, 2015 3:43 am
by jwessels
Hi Support,

I have the following problem; none of the host checks are updating and are stuck on the 1 May. There are no active checks in the queue or in the
nagiosatt2.png
I am receiving alerts via email and can see the checks in /var/log/messages, but not in the event log.
nagiosatt1.png
Thank you!

Re: Host Status not Updating

Posted: Thu May 07, 2015 9:41 am
by tgriep
Can you Click Admin > Monitoring Engine Status and make sure Active Checks are enabled?
Can you provide a screen shot that too?

Re: Host Status not Updating

Posted: Thu May 07, 2015 1:09 pm
by jwessels
Hi,

As requested here is the screen shot, everything is running
nagiosactivechecks.png
as well as the all the components
nagioscomp.png

Re: Host Status not Updating

Posted: Thu May 07, 2015 1:14 pm
by jdalrymple
Can you tail the last 40 or so lines of /usr/local/nagios/var/nagios.log and show us that?

Re: Host Status not Updating

Posted: Thu May 07, 2015 1:21 pm
by jwessels
Here is the last 40 lines
40lines.png

Re: Host Status not Updating

Posted: Thu May 07, 2015 1:41 pm
by jolson
It looks like your ndomod connection may be broken - it's possible that your nagios user expired. Please check the age of the 'nagios' user to ensure that's not the case:

Code: Select all

chage -l nagios
Otherwise, we'll want to turn on ndo2db debugging and restart ndo2db:

Code: Select all

sed -i 's/debug_level=0/debug_level=-1/g' /usr/local/nagios/etc/ndo2db.cfg

Code: Select all

service ndo2db restart
Check on the logs we've enabled:

Code: Select all

tail -n50 /usr/local/nagios/var/ndo2db.debug

Code: Select all

head /usr/local/nagios/var/ndo2db.debug

Re: Host Status not Updating

Posted: Thu May 07, 2015 2:00 pm
by jwessels
Here is the output;
password seems fine but,

Code: Select all

[root@tsamarnagios ~]# chage -l nagios
Last password change                                    : May 12, 2014
Password expires                                        : never
Password inactive                                       : never
Account expires                                         : never
Minimum number of days between password change          : 0
Maximum number of days between password change          : 99999
Number of days of warning before password expires       : 7
ndo2db seems a bit broken

Code: Select all

[root@tsamarnagios ~]# service ndo2db restart
ndo2db was not running... could not stop
Starting ndo2db:Could not bind socket: Address already in use
 done.
[root@tsamarnagios ~]# service ndo2db status
ndo2db is not running but subsystem locked
here is the output for the logs
ndolog.txt
headndo.txt

Re: Host Status not Updating

Posted: Thu May 07, 2015 2:29 pm
by jdalrymple

Code: Select all

[jdalrymple@localhost nagiosxi]$ sudo pkill -9 ndo2db
[jdalrymple@localhost nagiosxi]$ sudo rm /usr/local/nagios/var/ndo2db.lock
[jdalrymple@localhost nagiosxi]$ sudo /etc/init.d/ndo2db start
Starting ndo2db: done.
[jdalrymple@localhost nagiosxi]$ sudo /etc/init.d/nagios restart
Running configuration check...
Stopping nagios:. done.
Starting nagios: done.

Re: Host Status not Updating

Posted: Thu May 07, 2015 11:52 pm
by jwessels

Code: Select all

[root@tsamarnagios ~]# sudo pkill -9 ndo2db
[root@tsamarnagios ~]# sudo rm /usr/local/nagios/var/ndo2db.lock
You have new mail in /var/spool/mail/root
[root@tsamarnagios ~]# sudo /etc/init.d/ndo2db start
Starting ndo2db:Could not bind socket: Address already in use
 done.
[root@tsamarnagios ~]# sudo /etc/init.d/nagios restart
Running configuration check...done.
Stopping nagios: .done.
Starting nagios: done.
[root@tsamarnagios ~]#
I did the following:

Code: Select all

[root@tsamarnagios var]# rm ndo2db.lock
rm: remove regular empty file `ndo2db.lock'? y
[root@tsamarnagios var]# rm ndo.sock
rm: remove socket `ndo.sock'? y
You have mail in /var/spool/mail/root
[root@tsamarnagios var]# /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2db.cfg
[root@tsamarnagios var]# sudo /etc/init.d/ndo2db stop
Stopping ndo2db: done.
[root@tsamarnagios var]# sudo /etc/init.d/ndo2db start
Starting ndo2db: done.
rebooted server & Nagios is running again

Re: Host Status not Updating

Posted: Fri May 08, 2015 8:47 am
by lmiltchev
I am glad your issue has been resolved! Do you want us to keep the topic open for a while in case the issue resurfaces?