Service checks keep postponing

[tgriep]

Could you run the following command and post the output here?

Code: Select all

ll /usr/local/nagios/var/

[rkymtnhigh]

Sure!

[jdalrymple]

Are there any ugly messages in /var/log/mysqld.log?

[rkymtnhigh]

Are there any ugly messages in /var/log/mysqld.log?

I think we are getting somewhere. I see tons of "Incorrect key file for table XXX - try to repair it"

Seems to be servicestatus and systemcommands mainly. I did run a table repair before posting, but maybe I need to get more aggressive?

[abrist]

Yeah, try to run our full database repair script:

Code: Select all

/usr/local/nagiosxi/scripts/repair_databases.sh

Once complete, wait 10 minutes, check the last check time, and then finally check the mysqld logs again:

Code: Select all

tail -25 /var/log/mysqld.log

[rkymtnhigh]

I'm not seeing any more table errors, in fact I havent gotten any events since I repaired the tables.
Checks still are not running

[jdalrymple]

Code: Select all

/etc/init.d/nagios stop
/etc/init.d/ndo2db restart
/etc/init.d/nagios start

or maybe even

Code: Select all

reboot

[rkymtnhigh]

no luck. after rebooting it forced a check which completed successfully (except for those still in pending), but they did not run again.

I really appreciate all the help, this just doesn't look good

[jdalrymple]

It's salvageable, always is. Is mysqld.log clean right now? Please look again.

[rkymtnhigh]

Hardly any events since the reboot yesterday