Nagios XI performance is too slow

[ganeshkagde]

Hi Team,

we are working on nagios xi product since last two month, till this time we have enrolled 80 host and 7000 services are being monitoring. i have attached all required information.

[scottwilkerson]

Your load on this Linux server is 885 with over 3000 concurrent processes, something is seriously wrong.

It is possible you may need to just reboot the server if it doesn't respond, but if you can get into the GUI, I would like to see a system profile from Admin -> System Profile

[ganeshkagde]

Hi,

PFA system profile.

[scottwilkerson]

A very large portion of your CPU is being used by something called "OAS Manager" which is not part of Nagios.

However searching through some of the logs I did see several other issues, you are hitting the max connections to the database, set the following in /etc/my.cnf
under

Code: Select all

[mysqld]

add

Code: Select all

max_connections=500

Then restart mariadb

Also, you likely need more than 4 cores to handle all this processing.

[ganeshkagde]

@scottwilkerson

I have made changes, i will let you know status.

[scottwilkerson]

Great, give it some time and let us know if it improves or not.

[ganeshkagde]

Hi Team,

Still its too much lagging after making below changes, however services are frequently getting critical, PFA for the same.

[scottwilkerson]

Lets again attach current profile from Admin -> System Profile

Thanks

[ganeshkagde]

HI,

PFA system profile for the same.

[kyang]

A very large portion of your CPU is being used by something called "OAS Manager" which is not part of Nagios.

Code: Select all

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
12346 root      20   0 1772336 408976   6224 S 122.2  0.8 493:25.72 OAS Manager

As scott mentioned, the OAS Manager is still consuming a lot of your CPU.

You may also want to increase your kernel message queues.

Code: Select all

ndo2db: Error: max retries exceeded sending message to queue. Kernel queue parameters may need to be tuned. See README.
ndo2db: Warning: queue send error, retrying...

Follow this kb article to increase the values.
https://support.nagios.com/kb/article.php?id=139

Make sure to run these commands after making the changes:

Code: Select all

service nagios stop
service ndo2db restart
service nagios start

Once, that is done please show us the output of this:

Code: Select all

ipcs -q