Services disappeared off host, but still listed in Core Conf

[GldRush98]

In the regular host services screen, my main core's services have all vanished:

missingservices1.JPG

But If I check the core config manager, they are all still listed there:

missingservices2.JPG

I've tried reapplying the configuration and rebooting the server, but the services are still missing... even though they're really there. What is going on?

[GldRush98]

Ok, I reapplied the configuration several more times and they finally showed up. I didn't even change anything between applying configurations.
What in the world?

[nscott]

That looked like mysqld was unavailable. Do you see any major errors in /usr/local/nagios/var/nagios.log ?

Did you get any mail in /var/spool/mail/root about mysql?

[GldRush98]

This happened again.

[root@localhost ~]# service mysqld status
mysqld (pid 2551) is running...

There is nothing in the mail log (last thing was the database backup message from this morning).

I have applied the configuration several times and it is still not listing the services under the Core1.
Is there anything else you'd like me to check while the issue is occurring?

[nscott]

GldRush,

Do this:

Code: Select all

ps aux | grep '/usr/local/nag*ios/bin/nagios -d'

This should return exactly one thing, the nagios process. If this is returning two things than this is probably your problem.

so then

Code: Select all

killall -9 nagios
service nagios restart

[GldRush98]

There was only one. I figured killing it and restarting the service was worth a shot any way. Didn't help. Applied configuration again, didn't help.

[root@localhost ~]# ps aux | grep '/usr/local/nag*ios/bin/nagios -d'
nagios 14049 1.6 0.3 19344 7460 ? Ssl 10:50 2:11 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg
[root@localhost ~]# killall -9 nagios
[root@localhost ~]# service nagios restart
Running configuration check...done.
Stopping nagios: /etc/init.d/nagios: line 67: kill: (14049) - No such process
done.
Starting nagios: done.
[root@localhost ~]#

I rebooted the Nagios server, still missing. I reapplied one more time after the reboot and the services FINALLY came back.

[nscott]

Ok, well thats good to hear, next time it happens do this.

service mysqld stop
killall -9 nagios
service ndo2db stop
service mysqld start
service nagios start
service ndo2db start