Graphs don't work every night

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
bosecorp
Posts: 929
Joined: Thu Jun 26, 2014 1:00 pm

Re: Graphs don't work every night

Post by bosecorp »

I did that this morning. I changed that to 60 and restarted the services. that was this morning around 2 am. But still everything went back to normal around 3-4 am.

I could always stop backups tonight. but that is not ideal
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Graphs don't work every night

Post by abrist »

Are there any nightly backups that you run or anything else that would cause load to spike into the 100s?
Until you solve your load problem, you will probably not be able to get graphing under control. What is load at currently?

Code: Select all

w
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
User avatar
lmiltchev
Bugs find me
Posts: 13589
Joined: Mon May 23, 2011 12:15 pm

Re: Graphs don't work every night

Post by lmiltchev »

Your load went through the roof...

Code: Select all

Line 10357: [05-06-2015 05:51:44] NPCD: WARN: MAX load reached: load 314.510000/40.000000 at i=1
The "load_threshold" set to 60 won't help with such a high load values... Have you checked the I/O when the load is high? Have you considered moving your Nagios XI instance to a dedicated physical server?
Be sure to check out our Knowledgebase for helpful articles and solutions!
bosecorp
Posts: 929
Joined: Thu Jun 26, 2014 1:00 pm

Re: Graphs don't work every night

Post by bosecorp »

so can increase to 300 or more. I included a screenshoot with the amount of CPU i have assigned to this VM
jdalrymple
Skynet Drone
Posts: 2620
Joined: Wed Feb 11, 2015 1:56 pm

Re: Graphs don't work every night

Post by jdalrymple »

Does your host have enough resources to allocate at this time of day? You may be exhausting the resources on the parent host and experience trickle down into the VM. One way to be sure would be to reserve CPU for that host, but your other guests may suffer as a result.
bosecorp
Posts: 929
Joined: Thu Jun 26, 2014 1:00 pm

Re: Graphs don't work every night

Post by bosecorp »

Yes, I do have enough resources on the host
jdalrymple
Skynet Drone
Posts: 2620
Joined: Wed Feb 11, 2015 1:56 pm

Re: Graphs don't work every night

Post by jdalrymple »

bosecorp wrote:Yes, I do have enough resources on the host
Clearly the guest does NOT have enough resources otherwise the load would not spike the way it did. Either we will have to determine what is running at that time to cause the high utilization or we will have to add more resources to the guest.

Do you have staff that can monitor the Nagios host's processes during the time when the graphs fail populate?
bosecorp
Posts: 929
Joined: Thu Jun 26, 2014 1:00 pm

Re: Graphs don't work every night

Post by bosecorp »

this is the load for the last week

one is CPU and the other is memory
You do not have the required permissions to view the files attached to this post.
Last edited by bosecorp on Thu May 07, 2015 3:21 pm, edited 2 times in total.
User avatar
lmiltchev
Bugs find me
Posts: 13589
Joined: Mon May 23, 2011 12:15 pm

Re: Graphs don't work every night

Post by lmiltchev »

Hi I/O can cause high load as well. If you are sure that you have plenty of resources, you can increase the "load_threshold" to give it a try. I would also recommend increasing the timeout value in the "/usr/local/nagios/etc/pnp/process_perfdata.cfg" as you had bunch of timeouts in the perdata.log.

Code: Select all

TIMEOUT = 20
Restart npcd.

Code: Select all

service npcd restart
Let us know if this fixed your issue.
Be sure to check out our Knowledgebase for helpful articles and solutions!
bosecorp
Posts: 929
Joined: Thu Jun 26, 2014 1:00 pm

Re: Graphs don't work every night

Post by bosecorp »

Hi dmiltchev

done

JR Dalrymple

please look at the performance graphs for this VM. took them from vCenter
Locked