Nagios Service restart with ndoutils configured

[yunushaikh]

Hello Experts,

I noticed that when I restart the nagios service and open the nagios page, it takes around 2-3 min to show all the services and hosts.

I have configured ndoutils with my nagios to store all the data in MYSQL. On troubleshooting that why it is taking so much time, I found when the nagios service restart happens that time ndoutils is clearing all the entries from nagios_hosts and nagios_services table and then reinserting it again. Since there are lot of services, it is taking lot of time to load. Is there any solution for this.
This is a problem for us because we keep on adding new services continuously on the nagios server and every time we restart nagios it takes time to come up.

Any solution to this will be appreciated.
Thanks in advance.

[rkennedy]

To assist you better I have a few questions -

How many services are you monitoring?
How many hosts are you checking?
How many CPU's are allocated to this machine?
What is the result of top|head -5?

[yunushaikh]

To assist you better I have a few questions -

How many services are you monitoring?
How many hosts are you checking?
How many CPU's are allocated to this machine?
What is the result of top|head -5?

top |head -5

top - 07:59:38 up 160 days, 18:39, 1 user, load average: 0.64, 0.85, 0.89
Tasks: 1776 total, 1 running, 1775 sleeping, 0 stopped, 0 zombie
Cpu(s): 1.2%us, 0.5%sy, 0.0%ni, 97.4%id, 0.9%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 529262064k total, 486021144k used, 43240920k free, 873980k buffers
Swap: 4194296k total, 4194216k used, 80k free, 221367972k cached


I am monitoring 824 services and 15 hosts in Nagios.

64 CPU's are there and this server also has MySQL instances.

[hsmith]

Is that the top output for the Nagios machine, or is it the output of the machine that is hosting the one that Nagios is on? We're interested in what's actually allocated to the Nagios VM, if it is on its own VM.

[yunushaikh]

Nagios is also installed on the same server.

[hsmith]

Nagios is installed on the server with 64 cores and 500 some GB of RAM? Not a VM running on it?

[yunushaikh]

Yes sir

that Machine is actually hosting lot of MySQL databases as well and it is not only for nagios.

[hsmith]

Having too many cores can be a bad thing.

This article explains the issue. http://www.gabesvirtualworld.com/how-to ... rformance/

Is there a way you can migrate this to its own isolated VM? It's pretty tough to say what could be causing it, especially because it's not isolated.

What OS is this running on? cat /etc/*release*

[yunushaikh]

It is centos 6.6

[rkennedy]

Is there a way you can migrate this to its own isolated VM? It's pretty tough to say what could be causing it, especially because it's not isolated.

I would recommend running Nagios on a virtual server of it's own. With that much resources, and unknowing of your system - it's hard for us to judge what could be slowing it down. Is that a possibility?