Very high load with many SNMP checks

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
Locked
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Very high load with many SNMP checks

Post by BanditBBS »

On my second "large" XI server I run quite a few SNMP checks of network equipment using check_nwc_health plugin from console labs. I have used this plugin for years with no issue but this is by far the most network checks I have done in XI. It is causing quite a high load on on my XI host that I had to set a limit on concurrent checks(which is causing issues of its own). Does anyone have experience with a ton of SNMP checks or the check_nwc_health plugin to tell me if it is the SNMP polling itself or the plugin that is causing the high load? And any hints on system settings I could make to alleviate some of the load?
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: Very high load with many SNMP checks

Post by ssax »

Please PM me a copy of your profile, you can download it from Admin > System Profile > Download Profile and I'll take a look to see what's going on.
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: Very high load with many SNMP checks

Post by ssax »

It certainly looks like it's just check_nwc_health that's causing the problem. I see a few others experiencing it on google without any resolution.

Are you running the latest version of the plugin? Which version?

You could always setup gearman and split the checks to external workers to spread out the load.
-- This would be your next step anyways as you already have a RAMDisk

https://assets.nagios.com/downloads/nag ... ios_XI.pdf
https://support.nagios.com/kb/article.php?id=484

Let's check the DB tables sizes:
- NOTE: You may need to adjust the -h 127.0.0.1, the -uroot, and -pnagiosxi in the first command if your DB is offloaded to another server and/or you've changed the root mysql password

Code: Select all

echo "SELECT table_name AS 'Table', round(((data_length + index_length) / 1024 / 1024), 2) 'Size in MB' FROM information_schema.TABLES WHERE table_schema IN ('nagios', 'nagiosql', 'nagiosxi');" | mysql -h 127.0.0.1 -uroot -pnagiosxi --table
Thanks!
Locked