[Mod Gearman Worker] How many hosts can it handle?

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
Locked
litsupport.box
Posts: 80
Joined: Wed Apr 02, 2014 7:24 am

[Mod Gearman Worker] How many hosts can it handle?

Post by litsupport.box »

Hello,

I have a mod gearman worker running on Cent OS 6.5, with the following specs: 2GB RAM, 2 CPU's, 20GB HDD, Virtual. I'm pretty new to Nagios so i'm not sure how many hosts/services 1 worker can handle when deployed.

In my testing environment (which is not ready yet) I've installed workers to do all the checks, but i haven't experienced any performance issues yet because it's only got 10 hosts to check at the moment.

Our Nagios XI instance was showing some performance issues so i want to deploy one or more workers (temporarily) to take over some work in our production environment. Were also noticing some false positives so we want to see if the workers fix this.

Please advise :)

Kind regards,

Farid
Nagios XI Version : 2014R2.6
fqdn 2.6.32-431.17.1.el6.x86_64 x86_64
CentOS release 6.5 (Final)
Gnome is not installed
Proxy appears to be in use
VMware Image
Mod Gearman
jolson
Attack Rabbit
Posts: 2560
Joined: Thu Feb 12, 2015 12:40 pm

Re: [Mod Gearman Worker] How many hosts can it handle?

Post by jolson »

Like too many things in IT, this depends on a high number of variables - the checks in question, the hardware in question, network latency, etc. I found the following excerpt from the Mod Gearman page: https://labs.consol.de/nagios/mod-gearman/#_performance
I used a sample Nagios installation with 20.000 Services at a 1 minute interval and a sample plugin which returns just a single line of output. I got over 300 Servicechecks per second, which means you could easily setup 100.000 services at a 5 minute interval with a single Nagios box. The amount of worker boxes depends on your check types.
The following page contains Mod Gearman benchmarks that may be of interest to you: http://labs.consol.de/blog/nagios/monit ... enchmarks/

So the question is the amount of checks Mod Gearman can handle - according to the above sources, up to 600,000 checks every 5 minutes per Nagios instance.
Twits Blog
Show me a man who lives alone and has a perpetually clean kitchen, and 8 times out of 9 I'll show you a man with detestable spiritual qualities.
litsupport.box
Posts: 80
Joined: Wed Apr 02, 2014 7:24 am

Re: [Mod Gearman Worker] How many hosts can it handle?

Post by litsupport.box »

Thank you this answers my question. Topic can close.
Nagios XI Version : 2014R2.6
fqdn 2.6.32-431.17.1.el6.x86_64 x86_64
CentOS release 6.5 (Final)
Gnome is not installed
Proxy appears to be in use
VMware Image
Mod Gearman
rajasegar
Posts: 1018
Joined: Sun Mar 30, 2014 10:49 pm

Re: [Mod Gearman Worker] How many hosts can it handle?

Post by rajasegar »

litsupport.box wrote:Thank you this answers my question. Topic can close.
If you have lots of perl based checks, you will get nowhere near that figure.

I am having 1765 hosts with 13658 services on a 12 Virtual CPU and 12Gb Ram and it is just about max it can handle.
It is using 2 x Xeon CPU with 16 core at 2.9Ghz VMHost and running 10 RAID internal disk. DB is offloaded.
Almost all checks is at 5 minute interval.
5 x Nagios 5.6.9 Enterprise Edition
RHEL 6 & 7
rrdcached & ramdisk optimisation
litsupport.box
Posts: 80
Joined: Wed Apr 02, 2014 7:24 am

Re: [Mod Gearman Worker] How many hosts can it handle?

Post by litsupport.box »

rajasegar wrote:
litsupport.box wrote:Thank you this answers my question. Topic can close.
If you have lots of perl based checks, you will get nowhere near that figure.

I am having 1765 hosts with 13658 services on a 12 Virtual CPU and 12Gb Ram and it is just about max it can handle.
It is using 2 x Xeon CPU with 16 core at 2.9Ghz VMHost and running 10 RAID internal disk. DB is offloaded.
Almost all checks is at 5 minute interval.
Yes i figured.
Nagios XI Version : 2014R2.6
fqdn 2.6.32-431.17.1.el6.x86_64 x86_64
CentOS release 6.5 (Final)
Gnome is not installed
Proxy appears to be in use
VMware Image
Mod Gearman
tmcdonald
Posts: 9117
Joined: Mon Sep 23, 2013 8:40 am

Re: [Mod Gearman Worker] How many hosts can it handle?

Post by tmcdonald »

Again, variables :)

If you're satisfied with your answer I will close up the thread now.
Former Nagios employee
jolson
Attack Rabbit
Posts: 2560
Joined: Thu Feb 12, 2015 12:40 pm

Re: [Mod Gearman Worker] How many hosts can it handle?

Post by jolson »

Closing this thread - please open another one if you have additional questions. Thanks very much!
Twits Blog
Show me a man who lives alone and has a perpetually clean kitchen, and 8 times out of 9 I'll show you a man with detestable spiritual qualities.
Locked