ndo2db Hogging ALL the CPU

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: ndo2db Hogging ALL the CPU

Post by abrist »

This could still be due to ndomod instead of ndo2db . . . .
What process is to blame for the spike?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: ndo2db Hogging ALL the CPU

Post by BanditBBS »

abrist wrote:This could still be due to ndomod instead of ndo2db . . . .
What process is to blame for the spike?
Nothing that I can see. There is no difference as to when the spike isn't happening(when watching top).
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: ndo2db Hogging ALL the CPU

Post by scottwilkerson »

James,

Can you PM me your nagios.cfg and also, can you confirm/deny if you have checks that have specific timeperiods.

e.g. A "work hours" time period that kicks off at 9am and a whole bunch of additional checks are scheduled...

thanks
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: ndo2db Hogging ALL the CPU

Post by BanditBBS »

Getting called James on the forums is like being called to the principal's office, lol.

I sent the PM. As for special time periods for checks, yes there are some, but I can count them on less then one hand, for sure less than 2.
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: ndo2db Hogging ALL the CPU

Post by scottwilkerson »

I looked at the file, and nothing out of the ordinary there...
BanditBBS wrote: As for special time periods for checks, yes there are some, but I can count them on less then one hand, for sure less than 2.
Less than 2 timeperiods, or less than 2 hosts/services that use the time periods?

I know this is a shot in the dark, but trying to figure out what the heck could be running causing the spike all at the same time.

It would be interesting to see the processes that are running right when the load spiked. Maybe you could setup an event handler that runs when load on localhost goes above a certain threshold that would write some process information to a text time?
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: ndo2db Hogging ALL the CPU

Post by scottwilkerson »

We just came to another possible conclusion...

Do you have scheduled reports setup on this system?

I ask because the default "time" for scheduled reports is in fact 9:00am and if you have many that you have not changed the run time of, they could be all kicking off at the exact same time...
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: ndo2db Hogging ALL the CPU

Post by BanditBBS »

Is there a way to qeury the DB for a list....I have many users that may have done that. However, the CPU load spike may last for 10 hours or more, so is that a real possibility?
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: ndo2db Hogging ALL the CPU

Post by scottwilkerson »

Code: Select all

crontab -u apache -l
However, I was under the assumption that there was just a large spike at 9am, not likely to last throughout the day
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
User avatar
BanditBBS
Posts: 2474
Joined: Tue May 31, 2011 12:57 pm
Location: Scio, OH
Contact:

Re: ndo2db Hogging ALL the CPU

Post by BanditBBS »

Nah, it can last all day. 12 hours 20-200 load, next 12 hours 2-4 load, doing the exact same stuff. However, if it is fine around 9am, it more often then not will start the spike then.

Apparently only 3 scheduled reports so far, actually surprised me a little.
2 of XI5.6.14 Prod/DR/DEV - Nagios LogServer 2 Nodes
See my projects on the Exchange at BanditBBS - Also check out my Nagios stuff on my personal page at Bandit's Home and at github
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: ndo2db Hogging ALL the CPU

Post by abrist »

BanditBBS wrote:Apparently only 3 scheduled reports so far, actually surprised me a little.
Which reports? (if you have a db or logfile problem, certain reports could be to blame for load problems).
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
Locked