Have you guys been able to find out what might be causing this ? I will be reverting our servers back to 3.5.1 so i can carry on the roll out of the project.
Below is another excerpt of when the issue has kicked off. Don't know what the copy and paste has done now but it has put some of the columns side by side. Hope it is not too much of a problem :
Code: Select all
top - 02:08:54 up 27 days, 14:24, 4 users, load average: 30.67, 21.28, 17.86
Tasks: 218 total, 51 running, 167 sleeping, 0 stopped, 0 zombie
Cpu(s): 69.9%us, 16.6%sy, 0.0%ni, 12.5%id, 0.8%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 3927988k total, 3308128k used, 619860k free, 210456k buffers
Swap: 4200956k total, 260k used, 4200696k free, 2627300k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
26454 nagios 20 0 29376 12m 1108 S 6 0.3 128:17.41 nagios 12489 nagios 20 0 47380 7004 2820 R 4 0.2 0:00.13 check_snmp_port
12469 nagios 20 0 47388 7004 2820 R 4 0.2 0:00.12 check_snmp_port 12477 nagios 20 0 47380 7000 2816 R 4 0.2 0:00.12 check_snmp_port
12497 nagios 20 0 47380 7004 2820 R 4 0.2 0:00.11 check_snmp_port 12501 nagios 20 0 47384 7012 2824 R 4 0.2 0:00.11 check_snmp_port
12507 nagios 20 0 47384 7008 2820 R 3 0.2 0:00.10 check_snmp_port 12509 nagios 20 0 47384 7004 2820 R 3 0.2 0:00.08 check_snmp_port
12511 nagios 20 0 47388 7000 2816 R 3 0.2 0:00.08 check_snmp_port 12513 nagios 20 0 47380 7000 2820 R 3 0.2 0:00.08 check_snmp_port
12516 nagios 20 0 47388 7000 2816 R 3 0.2 0:00.08 check_snmp_port 12518 nagios 20 0 47388 7004 2820 R 3 0.2 0:00.08 check_snmp_port
12519 nagios 20 0 47384 7000 2816 R 3 0.2 0:00.08 check_snmp_port 12520 nagios 20 0 47384 7004 2820 R 3 0.2 0:00.08 check_snmp_port
12523 nagios 20 0 47384 7000 2816 R 3 0.2 0:00.08 check_snmp_port 12537 nagios 20 0 47380 7000 2820 R 3 0.2 0:00.08 check_snmp_port
12510 nagios 20 0 47388 7004 2820 R 2 0.2 0:00.07 check_snmp_port 12512 nagios 20 0 47384 7004 2820 R 2 0.2 0:00.07 check_snmp_port
12514 nagios 20 0 47384 7000 2816 R 2 0.2 0:00.07 check_snmp_port 12517 nagios 20 0 47380 6996 2816 R 2 0.2 0:00.07 check_snmp_port
12521 nagios 20 0 47380 7000 2820 R 2 0.2 0:00.07 check_snmp_port 12524 nagios 20 0 47388 7004 2820 R 2 0.2 0:00.07 check_snmp_port
12525 nagios 20 0 47388 7000 2816 R 2 0.2 0:00.07 check_snmp_port 12526 nagios 20 0 47384 6996 2816 R 2 0.2 0:00.07 check_snmp_port
12527 nagios 20 0 47384 7004 2820 R 2 0.2 0:00.07 check_snmp_port 12529 nagios 20 0 47384 7004 2820 R 2 0.2 0:00.07 check_snmp_port
12530 nagios 20 0 47392 6996 2820 R 2 0.2 0:00.07 check_snmp_port 12531 nagios 20 0 47380 7000 2820 R 2 0.2 0:00.07 check_snmp_port
12532 nagios 20 0 47380 6996 2816 R 2 0.2 0:00.07 check_snmp_port 12533 nagios 20 0 47380 6996 2816 R 2 0.2 0:00.07 check_snmp_port
12538 nagios 20 0 47384 7000 2820 R 2 0.2 0:00.07 check_snmp_port 12546 nagios 20 0 47384 7004 2820 R 2 0.2 0:00.07 check_snmp_port
12522 nagios 20 0 47380 6884 2720 R 2 0.2 0:00.06 check_snmp_port 12528 nagios 20 0 47384 7000 2820 R 2 0.2 0:00.06 check_snmp_port
12534 nagios 20 0 47380 6956 2788 R 2 0.2 0:00.06 check_snmp_port 12536 nagios 20 0 47388 6888 2720 R 2 0.2 0:00.06 check_snmp_port
12539 nagios 20 0 47380 6880 2716 R 2 0.2 0:00.06 check_snmp_port 12540 nagios 20 0 47380 6880 2716 R 2 0.2 0:00.06 check_snmp_port
12542 nagios 20 0 47380 6956 2788 R 2 0.2 0:00.06 check_snmp_port 12544 nagios 20 0 47384 6960 2792 R 2 0.2 0:00.06 check_snmp_port
12547 nagios 20 0 47384 6964 2792 R 2 0.2 0:00.06 check_snmp_port 12548 nagios 20 0 47384 6884 2716 R 2 0.2 0:00.06 check_snmp_port
12549 nagios 20 0 47384 6880 2716 R 2 0.2 0:00.06 check_snmp_port 12550 nagios 20 0 47384 7000 2820 R 2 0.2 0:00.06 check_snmp_port
top - 02:09:09 up 27 days, 14:24, 4 users, load average: 23.96, 20.26, 17.57
Tasks: 176 total, 1 running, 175 sleeping, 0 stopped, 0 zombie
Cpu(s): 6.0%us, 0.8%sy, 0.0%ni, 93.2%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3927988k total, 3105396k used, 822592k free, 210460k buffers
Swap: 4200956k total, 260k used, 4200696k free, 2627324k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
8645 root 20 0 8876 1376 856 R 1 0.0 10:08.55 top 6068 root RT 0 28192 3652 2824 S 0 0.1 1:06.44 multipathd
1 root 20 0 10388 776 640 S 0 0.0 0:25.58 init 2 root 20 0 0 0 0 S 0 0.0 0:00.00 kthreadd
3 root RT 0 0 0 0 S 0 0.0 0:53.35 migration/0 4 root 20 0 0 0 0 S 0 0.0 4:50.96 ksoftirqd/0
5 root RT 0 0 0 0 S 0 0.0 0:55.30 migration/1 6 root 20 0 0 0 0 S 0 0.0 5:13.70 ksoftirqd/1
7 root RT 0 0 0 0 S 0 0.0 0:55.78 migration/2 8 root 20 0 0 0 0 S 0 0.0 5:21.53 ksoftirqd/2
9 root RT 0 0 0 0 S 0 0.0 0:56.53 migration/3 10 root 20 0 0 0 0 S 0 0.0 5:21.39 ksoftirqd/3
11 root 20 0 0 0 0 S 0 0.0 2:12.23 events/0 12 root 20 0 0 0 0 S 0 0.0 2:18.20 events/1
13 root 20 0 0 0 0 S 0 0.0 2:27.06 events/2 14 root 20 0 0 0 0 S 0 0.0 2:48.12 events/3
15 root 20 0 0 0 0 S 0 0.0 0:00.00 cpuset 16 root 20 0 0 0 0 S 0 0.0 0:00.00 khelper
17 root 20 0 0 0 0 S 0 0.0 0:00.00 netns 18 root 20 0 0 0 0 S 0 0.0 0:00.00 async/mgr
19 root 20 0 0 0 0 S 0 0.0 0:00.00 pm 20 root 20 0 0 0 0 S 0 0.0 0:02.90 sync_supers
21 root 20 0 0 0 0 S 0 0.0 0:03.67 bdi-default 22 root 20 0 0 0 0 S 0 0.0 0:00.00 kintegrityd/0
23 root 20 0 0 0 0 S 0 0.0 0:00.00 kintegrityd/1 24 root 20 0 0 0 0 S 0 0.0 0:00.00 kintegrityd/2
25 root 20 0 0 0 0 S 0 0.0 0:00.00 kintegrityd/3 26 root 20 0 0 0 0 S 0 0.0 0:00.60 kblockd/0
27 root 20 0 0 0 0 S 0 0.0 0:01.30 kblockd/1 28 root 20 0 0 0 0 S 0 0.0 0:00.96 kblockd/2
29 root 20 0 0 0 0 S 0 0.0 0:00.90 kblockd/3 30 root 20 0 0 0 0 S 0 0.0 0:00.00 kacpid
31 root 20 0 0 0 0 S 0 0.0 0:00.00 kacpi_notify 32 root 20 0 0 0 0 S 0 0.0 0:00.00 kacpi_hotplug
33 root 20 0 0 0 0 S 0 0.0 0:00.00 kseriod 38 root 20 0 0 0 0 S 0 0.0 0:00.00 kondemand/0
39 root 20 0 0 0 0 S 0 0.0 0:00.00 kondemand/1 40 root 20 0 0 0 0 S 0 0.0 0:00.00 kondemand/2
41 root 20 0 0 0 0 S 0 0.0 0:00.00 kondemand/3 42 root 20 0 0 0 0 S 0 0.0 0:00.00 khungtaskd
43 root 20 0 0 0 0 S 0 0.0 0:39.46 kswapd0 44 root 25 5 0 0 0 S 0 0.0 0:00.00 ksmd
45 root 20 0 0 0 0 S 0 0.0 0:00.00 aio/0 46 root 20 0 0 0 0 S 0 0.0 0:00.00 aio/1
Every 2.0s: free -m Tue May 27 02:09:57 2014
total used free shared buffers cached
Mem: 3835 3021 814 0 205 2565
-/+ buffers/cache: 250 3585
Swap: 4102 0 4102