Adding 4,000 Hosts

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Adding 4,000 Hosts

Post by BanditBBS »

As the subject states, I'm going to possibly be adding 4,000 hosts which will have about 7 services each by default. Some of course will have more. So, at my math, that is 28000 checks being added. I'll be using the bulk cloning tool and adding half at once and then the other half(prod+dev). Oh, and these will be all WMI checks on windows servers.

In my main area I have two workers using mod_gearman, the primary nagios server and another worker. Should I just go ahead and turn up another worker now or will those two workers be enough to add that many checks? Any other items I need to think about?

Thanks!

p.s. It feels so good to be this close to winning the war of what does the Windows monitoring in my company :)
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Adding 4,000 Hosts

Post by scottwilkerson »

Couple thing to think about. Before adding all of them with the bulk cloning wizard I would set (or increase) max_input_vars in /etc/php.ini
Also, you will likely need a higher than default max_execution_time

Code: Select all

max_input_vars = 100000
max_execution_time =600
then

Code: Select all

service httpd restart
As for the workers, if you have strong hardware, and 5 minute check intervals, I would say that the 2 mod_gearman workers should do it, but might not be a bad idea to have a 3rd on the ready.

If you haven't done so, I would strongly suggest setting up a RAM disk in a large environment like this, it can really reduce the disk I/O which is the one thing that can bring your XI server to it's knees.
http://library.nagios.com/library/produ ... n-nagiosxi
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: Adding 4,000 Hosts

Post by BanditBBS »

Is it odd that I don't have the max_input_vars in my php.ini?

And what about memory limit?
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: Adding 4,000 Hosts

Post by BanditBBS »

Also, my two dat files are 14MB right now, how much will they be growing when I add the many more hosts and services? I want to make sure I size the ram disk properly. My current numbers are 552 hosts and 4100 services. Can I simply do math to figure out how large the files will be growing or is it more complicated than that?
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Adding 4,000 Hosts

Post by abrist »

You could math it out to predict what usage would be under optimal circumstances. But, I would give it some extra beyond that just in case the added checks slow the server down, causing anything else using the ramdisk (rrdcached/perfdata) to use more spooling space.
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: Adding 4,000 Hosts

Post by BanditBBS »

abrist wrote:You could math it out to predict what usage would be under optimal circumstances. But, I would give it some extra beyond that just in case the added checks slow the server down, causing anything else using the ramdisk (rrdcached/perfdata) to use more spooling space.
Works for me....just waiting on the answer to my php configuration question now.
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
sreinhardt
-fno-stack-protector
Posts: 4366
Joined: Mon Nov 19, 2012 12:10 pm

Re: Adding 4,000 Hosts

Post by sreinhardt »

Memory limit should be in the php config by default, and would be slightly strange if it is not. The max_input_vars is not standard to have in the config by default and generally needs to be created.
Nagios-Plugins maintainer exclusively, unless you have other C language bugs with open-source nagios projects, then I am happy to help! Please pm or use other communication to alert me to issues as I no longer track the forum.
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: Adding 4,000 Hosts

Post by BanditBBS »

sreinhardt wrote:Memory limit should be in the php config by default, and would be slightly strange if it is not. The max_input_vars is not standard to have in the config by default and generally needs to be created.
Oh, memory limit is in there, I was asking should I increase that from the 128M that it is currently set at.
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Adding 4,000 Hosts

Post by abrist »

I would suggest yes. If your server has 8gb of ram or more, you should be alright moving it to 256mb as that would still allow for 40+ LARGE (256mb) sessions.
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: Adding 4,000 Hosts

Post by BanditBBS »

abrist wrote:I would suggest yes. If your server has 8gb of ram or more, you should be alright moving it to 256mb as that would still allow for 40+ LARGE (256mb) sessions.
Ok, 16GB, so made it 256M for PHP. Also made my ram disk 500M and think it is all working. Does just doing an "apply configuration" after everything is done, make it all take effect?
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
Locked