Unusually High CPU load today

[stebbo]

Hi All,

I've had an unusually high CPU load all day today, which seems to have finally managed to return to normal. I am running 2012.R2.2 on a Centos 6.4 Virtual Machine running under VMWare Fusion on a Mac host. I upgraded a week or two ago.

Our CPU load is normally around 0.5 to 1.0 and it runs like that for extended periods of time. Last nite, around 10pm, the CPU load increased rapidly and it has been running around 6.0 to 7.0 all day. I tried a reboot earlier this morning but it came backup up straight to these high levels.

I ran top and noticed a large number of httpd processes and these were taking up most of the CPU. User CPU was as high as 63% at some stages with 6 of the httpd processes each consuming 4% or more. I noticed the mysqld process up there at some stages too.

I have 1Gb RAM allocated, and currently 210Mb is free. I don't have graphs for the memory usage, but the swap usage is almost deal level at pretty much zero.

The CPU load appears to have settled back at 0.5/1.0 for now, but I'm curious as to what may have been the cause of the increase.

Cheers,
Chris.

[lmiltchev]

Any backups, that were run on the server that could've caused the increased load? Did you the check log files for clues?

Code: Select all

tail /var/log/messages
tail /var/log/httpd/error_log
tail /var/log/mysqld.log

[abrist]

Many things can cause this behavior (as you are well aware). Have you set up a large number of scheduled reports to run overnight? Do you have any checks that only happen during the night? If you are running one of the newer versions of XI, the profile component has been updated to include tails of a number of logs. You could PM the profile.zip to myself or another nagios employee on the forums here so that we can dig through the logs. To download the profile, go to Admin --> System Profile --> Download Profile.