NagiosXI-Database repair script failed-URGENT HELP NEEDED

[akumarhe1868]

Hello,

For past few days, we were frequently getting database error and on executing the script /usr/local/nagiosxi/scripts/repair_databases.sh we get below error:

Please advise urgently to resolve the issue as monitoring getting affected.

we were added 200 GB space but still get same issue after some time.

/usr/local/nagiosxi/scripts/repairmysql.sh: line 134: 30389 Segmentation fault $cmd $t --sort_buffer_size=256M
MySQL Daemon failed to start.
Starting mysqld: [FAILED]

nagios database repair succeeded
nagiosql database repair succeeded
nagiosxi database repair FAILED, please check output above!

Thanks,
Anand

[ssax]

What is the output of these commands:

Code: Select all

df -h
df -i
service mysqld restart
service mysqld status
tail -n100 /var/log/mariadb/mariadb.log /var/log/mysqld.log

[akumarhe1868]

Thanks for your reply.

As requested, attached output on executing the commands along with the System Status which is also changing to RED frequently on some of the components.

We are also not able to do any new configurations/Modifications in Nagios and host/service not displayed in screen instead it shows "website cannot display the page, causes mostly like "website under Maintenance ,the website has a programming error.

when I try to disable notifications, it says "your request was not processed in a timely manner, It may still execute, as the server may ne temporarily busy.

Please provide the necessary steps to clear the issue and to make the monitoring smoothly.

Waiting for your quick reply...

Thanks,
Anand

[cdienger]

How large are the files in the /var/lib/mysql/nagiosxi/ directory? Try repairing the tables one at a time and note any that you have problems with:

Code: Select all

cd /var/lib/mysql/nagiosxi/
myisamchk -r -f xi_auditlog --sort_buffer_size=256M
myisamchk -r -f xi_commands --sort_buffer_size=256M
myisamchk -r -f xi_eventqueue --sort_buffer_size=256M
myisamchk -r -f xi_events --sort_buffer_size=256M
myisamchk -r -f xi_incidents --sort_buffer_size=256M
myisamchk -r -f xi_meta --sort_buffer_size=256M
myisamchk -r -f xi_options --sort_buffer_size=256M
myisamchk -r -f xi_sysstat --sort_buffer_size=256M
myisamchk -r -f xi_usermeta --sort_buffer_size=256M
myisamchk -r -f xi_users --sort_buffer_size=256M