Nagios Fusion Slow Response

[toodaly]

I'm trying to use Nagios Fusion to monitor 32 Nagios XI servers. In my test environment, I have four live Nagios XI servers. It works as expected when I configure Nagios Fusion to monitor the four Nagios XI servers. However when I try to configure the remaining 28 servers, Nagios Fusion significantly slows down when I'm on the Server Credentials page. I get the same behavior with all of the COTS we install with Nagios Fusion and with an installation with just RHEL 6 and Nagios Fusion.

I'm hoping you can reproduce it on your end with a clean install of Nagios Fusion and configure 30+ Nagios XI servers. I've unchecked the display checkbox and the performance is the same.

I'm using the latest version on a VM configured with 1 CPU and 40GB hard drive. I get the same behavior with 2GB, 4GB, 8GB of RAM. I don't know if its Nagios Fusion, but memory utilization is about 1.8GB.

Thanks.

[eloyd]

Can you do this command:

Code: Select all

grep -v "^#" /etc/httpd/conf/httpd.conf  | grep -v "^$" | less

And post the part that looks like this:

Code: Select all

MaxKeepAliveRequests 100
KeepAliveTimeout 15
<IfModule prefork.c>
StartServers       8
MinSpareServers    5
MaxSpareServers   20
ServerLimit      256
MaxClients       256
MaxRequestsPerChild  4000
</IfModule>
<IfModule worker.c>
StartServers         4
MaxClients         300
MinSpareThreads     25
MaxSpareThreads     75
ThreadsPerChild     25
MaxRequestsPerChild  0
</IfModule>

[toodaly]

Here's what I have:

Code: Select all

ServerTokens OS
ServerRoot "/etc/httpd"
PidFile run/httpd.pid
Timeout 60
KeepAlive Off
MaxKeepAliveRequests 100
KeepAliveTimeout 15
<IfModule prefork.c>
StartServers       8
MinSpareServers    5
MaxSpareServers   20
ServerLimit      256
MaxClients       256
MaxRequestsPerChild  4000
</IfModule>
<IfModule worker.c>
StartServers         4
MaxClients         300
MinSpareThreads     25
MaxSpareThreads     75
ThreadsPerChild     25
MaxRequestsPerChild  0
</IfModule>

Thanks.

[rkennedy]

What is the load like on the Fusion server when you try to do this? 1 CPU may be the chugging point.

Additionally, what version of XI are all of your servers running?

[hsmith]

I also have to ask if there is a reason you're monitoring so many XI servers - do you have a lot of different locations you're monitoring? If so, you could do something like mod gearman help another XI server out, or use check_nrpe on machines in that location do the checks - this could improve performance if you have multiple servers in multiple locations. Also, what version of XI are you running?

[toodaly]

CPU load seems to be fine, peaking at 10%

Here's my XI version information:
full=2012R2.9
major=2012
minor=R2.9
releasedate=2014-02-11
release=320

This version has been verified against our requirements and my management does not want to upgrade/re-verify due to schedule and budget.

This is being currently rolled out nation wide to 30-plus sites. Each site has a Nagios XI server monitoring about 200 devices including routers, switches, workstations, servers, and peripherals.

Thanks.

[tmcdonald]

Are you a current customer? This might be easier done over a ticket - can you email in to [email protected] and reference this thread? A remote session is likely going to be needed.

[toodaly]

Yes, I'm a current customer. I usually post to the general forum because I'm typically not in a hurry for an answer and hopefully this will reach a larger community of users.

I've observed that the slow down is only on the Fused Server Credentials page. Looking at the poller log (tail -f), it tries to ping the non-existent server and times out. The log seems to update once per minute where there are entries for three servers, so I assume a 20 second timeout per server. With 30 or so non-existent servers, the page took about 9 minutes to completely populate.

As I mentioned in a previous post, hopefully you can replicate this fairly easily on your end (install Nagios Fusion, manage (non-existent) fused servers, and navigate to the Fused Server Credentials page). If you see the same thing and say that this is expected behavior, I'm okay with that. I don't expect the user to even see that page as a regular user.

Thanks.

[rkennedy]

To clarify, what version of Fusion are you running?

Also, is there a reason you're adding non-existent servers to Fusion? This isn't something that it's going to expect, and since they are PHP calls and not AJAX calls, they are going to run parallel.

[toodaly]

I'm using the latest version (2014r1.1 64-bit).

The Nagios Fusion server will be installed prior to the installation of the remaining Nagios XI servers. Not a big deal. I can have the field technicians only add the Nagios XI servers that are already online. The others can be added to Nagios Fusion when they eventually come online.

Any news on when a beta version of the new Nagios Fusion will be available?

Thanks.