URGENT: Database can't recover

[highness]

We're seeing a bunch of these in the MySQL log:

170406 11:45:39 [ERROR] /usr/libexec/mysqld: Incorrect key file for table './nagios/nagios_customvariablestatus.MYI'; try to repair it

but when I try to repair the offloaded database, I get this:

Code: Select all

[email protected] (Linux) $ mysqlcheck -f -r -u root -pShoeFoot2 --databases nagios nagiosql -h db1.nagios.vsp.com
nagios.nagios_acknowledgements
error    : Can't create new tempfile: './nagios/nagios_acknowledgements.TMD'
error    : 30 when updating keyfile
status   : Operation failed
nagios.nagios_commands
error    : Can't create new tempfile: './nagios/nagios_commands.TMD'
error    : 30 when updating keyfile
status   : Operation failed

We did an upgrade from 5.2.9 to 5.4.2 yesterday and things seemed to be working well until a couple of hours ago.

[dwhitfield]

Is this the issue we have a ticket about? If so, is it ok if I go ahead and lock this up.

Also, are you able to access the customer forums? Those actually count against the SLA. If not, you should email [email protected] (assuming you are the individual I have the ticket with).

If this is not you, what are the outputs of

Code: Select all

df -i
df -h

on the db server?

[highness]

Please go ahead and close this ticket.

Yes, I am the one who has the ticket opened with you.