NagiosXI-DB_Tables Marked as crashed - Urgent

[maartin.pii]

Hi Guys,

I am having a really serious problem with my NagiosXI and I would need to have this resolved since my Customer has purchased a License and it's very important to get all things running as they should. Any kind of information will be appreciated.

Scenario:

Server: VMware VM
OS: CentOS 7
Nagios: Nagios XI - Last Update
Ramdisk //Following nagios ramdisk procedure

Errors:

I have many tables of nagios and nagiosxi db instance marked as crashed and they are causing Nagios not to work correctly. For example: I can't take availability reports.

The most common tables that get crashed are _logentries and _notifications //both from nagios instance. However, I also have many tables from nagiosxi marked as crashed which is kind of strange since the data that is stored there is not appreciable. For example I have nagiosxi_sysstat nagiosxi_events marked as crashed to.

The really strange thing is that if I follow this procedure:

https://support.nagios.com/kb/article.php?id=24

Or this one:

https://assets.nagios.com/downloads/nag ... tabase.pdf

Everything works ok for... 15 minutes and after that it start giving me the same errors once and again. So I don't understand how the tables can get corrupt in 15 minutes. I also have tried with _logentries and _notifications to truncate them as the procedure says but it's the same thing - 15 minutes later I get the same error.

This is a really urgent issue, if someone could help me I would really appreciate it.

Thanks in advance!

[Box293]

It sounds like you might be running out of disk space.

https://support.nagios.com/kb/article.php?id=26

[maartin.pii]

Hi @Box293 - No it's filesystem's space are okey. My Ramdisk get fills like once per month... However, when I followed the procedure it was ok and after that it get crashed.

Thanks in advance

[maartin.pii]

FileSystems:

S.ficheros Tamaño Usados Disp Uso% Montado en
/dev/mapper/VG_Nagios-lv_root 10G 3,1G 7,0G 31% /
devtmpfs 3,9G 0 3,9G 0% /dev
tmpfs 3,9G 54M 3,8G 2% /dev/shm
tmpfs 3,9G 439M 3,4G 12% /run
tmpfs 3,9G 0 3,9G 0% /sys/fs/cgroup
/dev/mapper/VG_Nagios-lv_tmp 5,0G 33M 5,0G 1% /tmp
/dev/mapper/VG_Nagios-lv_varlog 5,0G 3,4G 1,7G 67% /var/log
/dev/sda1 497M 165M 333M 34% /boot
tmpfs 783M 0 783M 0% /run/user/0
tmpfs 783M 0 783M 0% /run/user/1000
/dev/drbd0 222G 22G 189G 11% /drbd
tmpfs 2,0G 570M 1,5G 28% /var/nagiosramdisk



Note: Is there any recommendation about rotating logs in ramdisk?

Regards,

[tgriep]

You may want to run the following command to do an extended repair and to repair missing or corrupt headers in the tables for all of the databases on the server.

Code: Select all

mysqlcheck -f -r -u root -pnagiosxi --all-databases --use_frm

Try that and post if it works or not.

Which log files are you talking about that are on the ramdisk that you need to rotate?

[maartin.pii]

Hi tgriep - I will execute the command that you requested and let you know.

I was asking for the ramdisk's logs which are mentioned on the official doc: https://assets.nagios.com/downloads/nag ... giosXI.pdf

Regards,

[tgriep]

The npcd.log and the perfdata.log files should truncate themselves as well as the other files on the nagiosramdisk except the objects.cache and status.dat files.
The will grow other time is new host and service checks are added to the system but not by that much.
Let us know how the MYSQL repair works.

[maartin.pii]

Hi Guys - I have tried the following:

Code: Select all

mysqlcheck -f -r -u root -pnagiosxi --all-databases --use_frm 

I will give it a few days and let you know.

Regards,

[tgriep]

Cool, post back if you have any more questions.