Fresh install high load

[BanditBBS]

I downloaded the OVF and deployed to my home VM server to do some testing. I did nothing to it what so ever and it has high load. I finally was able to login during one of the high load periods and do a top:

Code: Select all

top - 22:37:28 up 2 days,  2:23,  1 user,  load average: 7.56, 7.21, 5.09
Tasks: 177 total,   8 running, 169 sleeping,   0 stopped,   0 zombie
Cpu(s): 78.0%us, 21.6%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.4%si,  0.0%st
Mem:   8061516k total,  1467416k used,  6594100k free,   156096k buffers
Swap:  2064376k total,        0k used,  2064376k free,   648732k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
10872 nagios    20   0  318m  29m 7956 R 27.5  0.4   0:04.37 php
11079 nagios    20   0  318m  29m 7972 R 27.2  0.4   0:03.30 php
 1527 apache    20   0  439m  29m 5248 S 22.5  0.4   4:02.16 httpd
10868 nagios    20   0  311m  21m 7864 R 20.2  0.3   0:04.98 php
10871 nagios    20   0  204m  17m 5156 R 20.2  0.2   0:05.65 php
10873 nagios    20   0  311m  22m 8344 R 20.2  0.3   0:04.19 php
11077 nagios    20   0  266m  20m 6684 R 20.2  0.3   0:04.68 php
 1762 postgres  20   0  210m 6720 4380 R  5.3  0.1   0:20.73 postmaster
11216 nagios    20   0 98.6m  692  596 S  4.0  0.0   0:00.12 tail
11218 nagios    20   0  103m  944  788 S  4.0  0.0   0:00.12 awk
11215 nagios    20   0 98.6m  844  728 S  3.6  0.0   0:00.11 iostat
11217 nagios    20   0 98.6m  672  576 S  3.6  0.0   0:00.11 head
11090 postgres  20   0  210m 5984 3700 S  3.0  0.1   0:00.64 postmaster
 6016 postfix   20   0 81364 3376 2500 S  1.3  0.0   0:00.57 pickup
11214 nagios    20   0  103m 1284 1112 S  1.0  0.0   0:00.12 sh
 1470 root      20   0 79072 3360 2472 S  0.7  0.0   0:04.93 master
11078 nagios    20   0  319m  29m 7924 S  0.7  0.4   0:00.93 php
 1346 mysql     20   0 1150m  37m 6492 S  0.3  0.5   3:37.35 mysqld
 1385 postgres  20   0  209m 6328 5264 S  0.3  0.1   1:55.99 postmaster
11083 nagios    20   0  311m  21m 7840 S  0.3  0.3   0:00.70 php
11204 root      20   0 15028 1368  988 R  0.3  0.0   0:00.15 top
    1 root      20   0 19232 1512 1224 S  0.0  0.0   0:02.79 init
    2 root      20   0     0    0    0 S  0.0  0.0   0:00.00 kthreadd
    3 root      RT   0     0    0    0 S  0.0  0.0   0:03.14 migration/0
    4 root      20   0     0    0    0 S  0.0  0.0   0:00.87 ksoftirqd/0
    5 root      RT   0     0    0    0 S  0.0  0.0   0:00.00 migration/0

What the heck could this be doing? The only thing it is monitoring is localhost. After seeing this issue, I did run a yum update and the problem persists. It shouldn't be my VM host, it has 8 XEON 2.4Ghz cores and 64GB of memory and this is the only VM running on it at the moment. It's a true server class server, an HP DL360G5.

EDIT: Looking at another post, they are having similar issues every 7 hours. Looking at my charts it seems about every 11 hours for me. I was trying to look at it but my load was 27, I couldnt use the server, I had to restart.

[abrist]

Trevor is working on reproducing this.
Were you using the 64bit ovf?
What XI version? 2014r1.1?

[BanditBBS]

Trevor is working on reproducing this.
Were you using the 64bit ovf?
What XI version? 2014r1.1?

64-Bit 1 CPU 2 Cores 8GB Ram.

Yes, version 1.1.

I have added a second CPU and also moved vm host(yes I have a farm at home) and the issues seems to be much better. I will move it back to the other host and see if it happens again, just to rule out my host for sure.

[tmcdonald]

Just downloaded 2014r1.1 64-bit OVA, no load problems so far. Did not log into XI interface, literally just logged in as root and ran top. Am I missing anything that you did?

[BanditBBS]

Let it sit for a day

[tmcdonald]

I figured as much, just didn't want to have it sit only to find out I did something differently.

[BanditBBS]

Check this out:

Capture.JPG

I know this isn't actually high anymore(it was close to 30 when I opened thread), but it seems to be on a pretty regular about 7 hour interval like WillemDH mentioned in his post here: http://support.nagios.com/forum/viewtop ... 16&t=27708

All mine is doing is localhost checks and whatever else was in the image provided. Not sure what would be happening every 7 hours to cause spikes. My issue since the upgrade on 2 of the servers are now show high I/O wait every so often as well, and both of these servers never showed any sign of this before the upgrade to 2014. I know I'm throwing a bunch of stuff out, just babbling to make sure I get everything out that I can before Wednesday

[slansing]

I just updated one of my 2014 1.0 VM's to 1.1 I'm going to jump on the troubleshooting bandwagon and see if I have the same result as you two after 7-11'ish hours. I had an initial 1 minute load average about .80 or so above where it was at version 1.0 but that has since dropped much lower.

[tmcdonald]

That looks unfortunately quite similar to my results:

ohno.png

As I said in the other thread with Willem, this is something we can look into since we've got it replicated in-house.

[BanditBBS]

Trevor, lock this up since its a dupe with Willem. No need to track two threads and his was first.