Performance issue on medium nagios installation

Support forum for Nagios Core, Nagios Plugins, NCPA, NRPE, NSCA, NDOUtils and more. Engage with the community of users including those using the open source solutions.
Locked
maol
Posts: 2
Joined: Wed Jun 25, 2014 9:50 am

Performance issue on medium nagios installation

Post by maol »

Hello,
we have a nagios installation that monitor about 250 host and 6000 services.

nagios is istalled on a physical dedicated server with a Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz (esa core) and 16GB of ram.

Our nagios is able to check about 20 services per second and 4 host per second.
We can see that the check rate is really lower than the scheduled rate (0% - 50%)

The machine does not seem to be overloaded at all:

Tasks: 461 total, 3 running, 422 sleeping, 0 stopped, 36 zombie
Cpu(s): 8.4%us, 4.0%sy, 0.0%ni, 87.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 16291780k total, 2272832k used, 14018948k free, 73380k buffers
Swap: 8216568k total, 0k used, 8216568k free, 896648k cached

What I’m doing wrong?

Is there a way to identify our bottleneck?
User avatar
eloyd
Cool Title Here
Posts: 2129
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: Performance issue on medium nagios installation

Post by eloyd »

Nagios will slowly spread out the service checks so that they do not all happen at the same time (like, every ten minutes at 10,20,30,40,50,0 minutes past the hour). So over time, if you're doing 20 services per SECOND, that's 1200 services per MINUTE, which is 72,000 per HOUR. To me, that sounds like a lot. I don't think you've got any sort of performance problem, but maybe my expectations are different than yours.

So what is your desired state?
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoydI'm a Nagios Fanatic!
maol
Posts: 2
Joined: Wed Jun 25, 2014 9:50 am

Re: Performance issue on medium nagios installation

Post by maol »

You're right, 20 check per seconds is not bad but is the best rate, it slow down to 2 ot 3 check per second sometimes, so we have sono serveces with

Code: Select all

The time since the last check of the service	43 min
that is not accettable.
User avatar
eloyd
Cool Title Here
Posts: 2129
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: Performance issue on medium nagios installation

Post by eloyd »

The time since the last check of the service 43 min
Where is this coming from? I'm not familiar with that specific line of text from a Nagios Core screen.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoydI'm a Nagios Fanatic!
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Performance issue on medium nagios installation

Post by abrist »

@OP: Any update on this?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
Locked