Long apply configurations

[WillemDH]

Code: Select all

ls -la /dev/mapper/*
crw-rw---- 1 root root 10, 58 Nov 22 15:13 /dev/mapper/control
lrwxrwxrwx 1 root root      7 Nov 22 15:13 /dev/mapper/VolGroup00-LogVol00 -> ../dm-1
lrwxrwxrwx 1 root root      7 Nov 22 15:13 /dev/mapper/VolGroup00-LogVol01 -> ../dm-0

Code: Select all

cat /proc/mounts
rootfs / rootfs rw 0 0
proc /proc proc rw,relatime 0 0
sysfs /sys sysfs rw,relatime 0 0
devtmpfs /dev devtmpfs rw,relatime,size=6082400k,nr_inodes=1520600,mode=755 0 0
devpts /dev/pts devpts rw,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /dev/shm tmpfs rw,relatime 0 0
/dev/mapper/VolGroup00-LogVol00 / ext4 rw,relatime,barrier=1,data=ordered 0 0
/proc/bus/usb /proc/bus/usb usbfs rw,relatime 0 0
/dev/sda1 /boot ext2 rw,relatime,errors=continue 0 0
none /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0
sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
svm03:/backups/SERVER /var/Digipolis/Backup nfs rw,nosuid,nodev,relatime,vers=3,rsize=65536,wsize=65536,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.54.18.38,mountvers=3,mountport=635,mountproto=udp,local_lock=none,addr=10.54.18.38 0 0
svm04:/naf /mnt/naf nfs ro,nosuid,nodev,noexec,relatime,vers=3,rsize=65536,wsize=65536,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.54.18.41,mountvers=3,mountport=635,mountproto=udp,local_lock=none,addr=10.54.18.41 0 0
nfsd /proc/fs/nfsd nfsd rw,relatime 0 0
tmpfs /var/nagiosramdisk tmpfs rw,relatime,size=1048576k 0 0

[avandemore]

I can't tell where /dev/mapper/VolGroup00-LogVol01 is being used, is it the swap device?

Code: Select all

# cat /proc/swaps

[WillemDH]

Code: Select all

cat /proc/swaps
Filename                                Type            Size    Used    Priority
/dev/dm-0                               partition       6553596 82392   -1

Seem to be so yes.

Code: Select all

free -m
             total       used       free     shared    buffers     cached
Mem:         11904       9911       1992         71        179       4440
-/+ buffers/cache:       5291       6612
Swap:         6399         80       6319

I hear you coming(and saw the recommendations in the other thread) => I'll see about upping the RAM to 32 GB and will post the new load results during apply.

Tx and grtz

[avandemore]

Sounds good. As it stands right now for your systems max IOPS appear to be halved. As in, whatever is the backing store for VolGroup00-LogVol00 and VolGroup00-LogVol01 are the ultimately the same physical device. So in a a situation where IO and memory pressure occur simultaneously, performance would severely impacted. Enough RAM would at least allow VolGroup00-LogVol00 to utilize the full amount of IOPS the backing store is capable of.

[WillemDH]

As it stands right now for your systems max IOPS appear to be halved

Can you explain further what you mean with this statement?

[avandemore]

Another way to say it, is in your data, dm-0 and dm-1 appear to be competing for IOPS.

[WillemDH]

Avandemore,

So the server has now 32 GB RAM. Performance in the Nagios XI gui is definitely better. But the performance of the apply configuration process is not better. I did several apply configurations and the problem where hosts and services who are ack'ed or in downtime are shown is still there.

here are my logs:

Code: Select all

Linux 2.6.32-642.6.2.el6.x86_64 (nagios01) 	12/09/2016 	_x86_64_	(6 CPU)

12/09/2016 01:57:24 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          76.76    0.00    6.52    0.00    0.00   16.72

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    10.00    0.00   24.00     0.00   272.00    11.33     0.03    1.04    0.00    1.04   0.75   1.80
dm-1              0.00     0.00    0.00   34.00     0.00   272.00     8.00     0.04    1.03    0.00    1.03   0.53   1.80

12/09/2016 01:57:25 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          44.80    0.00    4.36    0.00    0.00   50.84

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     4.00    0.00    6.00     0.00    80.00    13.33     0.01    1.50    0.00    1.50   1.33   0.80
dm-1              0.00     0.00    0.00   10.00     0.00    80.00     8.00     0.02    1.60    0.00    1.60   0.80   0.80

12/09/2016 01:57:26 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          55.95    0.00    5.53    0.67    0.00   37.86

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00 12221.00    0.00  157.00     0.00 99024.00   630.73     2.23   14.18    0.00   14.18   0.82  12.90
dm-1              0.00     0.00    0.00 12378.00     0.00 99024.00     8.00   245.00   19.79    0.00   19.79   0.01  12.90

12/09/2016 01:57:27 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          55.85    0.00    5.35    0.17    0.00   38.63

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    23.00    0.00   25.00     0.00   384.00    15.36     0.03    1.12    0.00    1.12   0.92   2.30
dm-1              0.00     0.00    0.00   48.00     0.00   384.00     8.00     0.05    1.00    0.00    1.00   0.48   2.30

12/09/2016 01:57:28 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          29.82    0.00    3.85    0.00    0.00   66.33

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    65.00    0.00   49.00     0.00   912.00    18.61     0.10    2.12    0.00    2.12   0.24   1.20
dm-1              0.00     0.00    0.00  114.00     0.00   912.00     8.00     0.25    2.23    0.00    2.23   0.11   1.20

12/09/2016 01:57:29 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.06    0.00    4.03    0.00    0.00   61.91

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     2.00    0.00    4.00     0.00    48.00    12.00     0.00    1.00    0.00    1.00   0.75   0.30
dm-1              0.00     0.00    0.00    6.00     0.00    48.00     8.00     0.01    1.00    0.00    1.00   0.50   0.30

12/09/2016 01:57:30 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          31.99    0.00    4.19    0.17    0.00   63.65

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00    7.00     0.00   112.00    16.00     0.01    0.71    0.00    0.71   0.71   0.50
dm-1              0.00     0.00    0.00   14.00     0.00   112.00     8.00     0.01    0.86    0.00    0.86   0.36   0.50

12/09/2016 01:57:31 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          62.14    0.00    5.03    0.34    0.00   32.50

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   265.00    0.00  245.00     0.00  4080.00    16.65     1.93    7.89    0.00    7.89   0.15   3.60
dm-1              0.00     0.00    0.00  510.00     0.00  4080.00     8.00     4.66    9.14    0.00    9.14   0.07   3.60

12/09/2016 01:57:32 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          33.84    0.00    4.86    0.17    0.00   61.14

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     3.00    0.00    9.00     0.00    96.00    10.67     0.01    1.00    0.00    1.00   0.67   0.60
dm-1              0.00     0.00    0.00   12.00     0.00    96.00     8.00     0.01    1.00    0.00    1.00   0.50   0.60

12/09/2016 01:57:33 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          29.22    0.00    3.67    3.01    0.00   64.11

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   108.00    0.00 2212.00     0.00 18560.00     8.39    28.18   12.74    0.00   12.74   0.10  21.70
dm-1              0.00     0.00    0.00 2320.00     0.00 18560.00     8.00    29.58   12.75    0.00   12.75   0.09  21.80

12/09/2016 01:57:34 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          36.96    0.00    5.35    0.67    0.00   57.02

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   190.00   75.00  691.00   600.00  7024.00     9.95     1.71    2.20    0.57    2.38   0.80  61.30
dm-1              0.00     0.00   75.00  887.00   600.00  7096.00     8.00     2.28    2.33    0.56    2.48   0.64  61.40

12/09/2016 01:57:35 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          25.55    0.00    6.26    0.00    0.00   68.19

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   175.00   12.00  159.00    96.00  2696.00    16.33     0.37    2.33    0.33    2.48   0.84  14.30
dm-1              0.00     0.00   12.00  328.00    96.00  2624.00     8.00     1.20    3.64    0.33    3.76   0.42  14.30

12/09/2016 01:57:36 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          41.48    0.00    6.75    1.85    0.00   49.92

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00 13696.00   61.00  137.00   488.00 109648.00   556.24     2.13   10.57    0.95   14.85   0.90  17.80
dm-1              0.00     0.00   62.00 13834.00   496.00 110672.00     8.00   240.82   17.04    0.95   17.11   0.01  17.70

12/09/2016 01:57:37 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          39.63    0.00    4.35    1.00    0.00   55.02

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7873.00   21.00  113.00   168.00 64904.00   485.61     1.01    7.75    1.14    8.97   0.72   9.60
dm-1              0.00     0.00   20.00 7985.00   160.00 63880.00     8.00   107.07   13.89    1.15   13.92   0.01   9.60

12/09/2016 01:57:38 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          25.80    0.00    5.70    5.03    0.00   63.48

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  4971.00    6.00 3450.00    48.00 67368.00    19.51    48.33   13.98    4.83   14.00   0.12  42.10
dm-1              0.00     0.00    6.00 8421.00    48.00 67368.00     8.00   135.82   16.12    4.83   16.13   0.05  42.10

12/09/2016 01:57:39 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.90    0.00    8.72    0.17    0.00   56.21

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     1.00    0.00    4.00     0.00    40.00    10.00     0.01    3.75    0.00    3.75   3.50   1.40
dm-1              0.00     0.00    0.00    5.00     0.00    40.00     8.00     0.02    4.80    0.00    4.80   2.80   1.40

12/09/2016 01:57:40 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          37.48    0.00   10.22    0.17    0.00   52.13

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     4.00    0.00    6.00     0.00    80.00    13.33     0.01    1.00    0.00    1.00   0.83   0.50
dm-1              0.00     0.00    0.00   10.00     0.00    80.00     8.00     0.01    1.00    0.00    1.00   0.50   0.50

12/09/2016 01:57:41 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          54.10    0.00   16.42    0.67    0.00   28.81

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00 12728.00    3.00  139.00    24.00 102936.00   725.07     2.14   15.06    5.33   15.27   0.66   9.40
dm-1              0.00     0.00    3.00 12867.00    24.00 102936.00     8.00   242.29   18.83    5.33   18.83   0.01   9.40

12/09/2016 01:57:42 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          42.28    0.00    6.38    0.00    0.00   51.34

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    16.00    0.00    9.00     0.00   200.00    22.22     0.01    1.67    0.00    1.67   1.33   1.20
dm-1              0.00     0.00    0.00   25.00     0.00   200.00     8.00     0.06    2.36    0.00    2.36   0.48   1.20

12/09/2016 01:57:43 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          32.05    0.00    4.19    0.17    0.00   63.59

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   300.00    0.00   53.00     0.00  2824.00    53.28     0.12    2.25    0.00    2.25   0.40   2.10
dm-1              0.00     0.00    0.00  353.00     0.00  2824.00     8.00     1.68    4.76    0.00    4.76   0.06   2.10

12/09/2016 01:57:44 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          24.46    0.00    3.35    0.00    0.00   72.19

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     4.00    0.00    4.00     0.00    64.00    16.00     0.00    1.00    0.00    1.00   1.00   0.40
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    1.00    0.00    1.00   0.50   0.40

12/09/2016 01:57:45 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          20.07    0.00    4.35    0.00    0.00   75.59

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     5.00    0.00    3.00     0.00    64.00    21.33     0.00    1.00    0.00    1.00   1.00   0.30
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    1.00    0.00    1.00   0.38   0.30

12/09/2016 01:57:46 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          42.91    0.00    5.41    0.68    0.00   51.01

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  3304.00    0.00  168.00     0.00 27776.00   165.33     1.78   10.61    0.00   10.61   0.45   7.50
dm-1              0.00     0.00    0.00 3472.00     0.00 27776.00     8.00    55.57   16.01    0.00   16.01   0.02   7.50

12/09/2016 01:57:47 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          35.79    0.00    4.52    0.17    0.00   59.53

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     6.00    0.00   16.00     0.00   176.00    11.00     0.02    1.06    0.00    1.06   0.88   1.40
dm-1              0.00     0.00    0.00   22.00     0.00   176.00     8.00     0.03    1.18    0.00    1.18   0.64   1.40

12/09/2016 01:57:48 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          38.26    0.00    5.03    0.00    0.00   56.71

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   766.00    0.00   58.00     0.00  6592.00   113.66     0.25    4.22    0.00    4.22   0.55   3.20
dm-1              0.00     0.00    0.00  824.00     0.00  6592.00     8.00     5.17    6.28    0.00    6.28   0.04   3.20

12/09/2016 01:57:49 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.34    0.00    4.36    0.17    0.00   61.14

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00   11.00     0.00   144.00    13.09     0.01    1.09    0.00    1.09   0.91   1.00
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.11    0.00    1.11   0.56   1.00

12/09/2016 01:57:50 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          53.52    0.00    8.05    1.34    0.00   37.08

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7134.00   81.00  538.00   648.00 61376.00   100.20     2.71    4.38    0.54    4.96   0.70  43.40
dm-1              0.00     0.00   81.00 7672.00   648.00 61376.00     8.00   141.80   18.29    0.57   18.48   0.06  43.40

12/09/2016 01:57:51 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          40.77    0.00    5.70    0.17    0.00   53.36

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    10.00    0.00   18.00     0.00   224.00    12.44     0.02    1.00    0.00    1.00   0.78   1.40
dm-1              0.00     0.00    0.00   28.00     0.00   224.00     8.00     0.03    0.96    0.00    0.96   0.50   1.40

12/09/2016 01:57:52 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          45.73    0.00    5.03    0.17    0.00   49.08

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    12.00    0.00   14.00     0.00   208.00    14.86     0.02    1.29    0.00    1.29   1.21   1.70
dm-1              0.00     0.00    0.00   26.00     0.00   208.00     8.00     0.03    1.27    0.00    1.27   0.65   1.70

12/09/2016 01:57:53 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          56.28    0.00    5.36    0.50    0.00   37.86

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   129.00    0.00  515.00     0.00  5112.00     9.93     7.00   11.45    0.00   11.45   0.14   7.10
dm-1              0.00     0.00    0.00  797.00     0.00  6376.00     8.00     8.24    8.86    0.00    8.86   0.09   7.20

12/09/2016 01:57:54 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          44.54    0.00    9.08   12.27    0.00   34.12

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   665.00    0.00 9101.00     0.00 78072.00     8.58   142.41   15.64    0.00   15.64   0.11 100.00
dm-1              0.00     0.00    0.00 9746.00     0.00 77968.00     8.00   153.26   15.71    0.00   15.71   0.10 100.00

12/09/2016 01:57:55 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          35.74    0.00    8.22   15.27    0.00   40.77

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  6947.00    0.00 3732.00     0.00 85544.00    22.92   139.37   37.66    0.00   37.66   0.26  98.80
dm-1              0.00     0.00    0.00 10548.00     0.00 84384.00     8.00   372.05   35.39    0.00   35.39   0.09  98.80

12/09/2016 01:57:56 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          38.63    0.00    6.02    0.17    0.00   55.18

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     6.00    0.00   10.00     0.00   128.00    12.80     0.01    1.20    0.00    1.20   1.00   1.00
dm-1              0.00     0.00    0.00   16.00     0.00   128.00     8.00     0.02    1.19    0.00    1.19   0.62   1.00

12/09/2016 01:57:57 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          36.01    0.00    4.69    0.00    0.00   59.30

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     6.00    0.00   12.00     0.00   144.00    12.00     0.01    0.92    0.00    0.92   0.67   0.80
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    0.89    0.00    0.89   0.44   0.80

12/09/2016 01:57:58 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          43.48    0.00    6.52    0.17    0.00   49.83

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00   18.00     0.00   208.00    11.56     0.02    1.11    0.00    1.11   0.83   1.50
dm-1              0.00     0.00    0.00   26.00     0.00   208.00     8.00     0.03    1.12    0.00    1.12   0.58   1.50

12/09/2016 01:57:59 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          26.17    0.00    3.19    0.00    0.00   70.64

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     3.00    0.00    7.00     0.00    80.00    11.43     0.01    1.43    0.00    1.43   1.14   0.80
dm-1              0.00     0.00    0.00   10.00     0.00    80.00     8.00     0.02    1.60    0.00    1.60   0.80   0.80

12/09/2016 01:58:00 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          49.16    0.00    7.53    1.51    0.00   41.81

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7100.00    1.00  114.00     8.00 57712.00   501.91     1.39   12.12   17.00   12.08   0.81   9.30
dm-1              0.00     0.00    1.00 7214.00     8.00 57712.00     8.00   154.57   21.42   17.00   21.42   0.01   9.30

12/09/2016 01:58:01 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          62.71    0.00    8.03    0.33    0.00   28.93

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    15.00    0.00   29.00     0.00   352.00    12.14     0.04    1.21    0.00    1.21   0.86   2.50
dm-1              0.00     0.00    0.00   44.00     0.00   352.00     8.00     0.05    1.11    0.00    1.11   0.57   2.50

12/09/2016 01:58:02 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          55.52    0.00   13.04    0.17    0.00   31.27

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   302.00    0.00   44.00     0.00  2768.00    62.91     0.07    1.68    0.00    1.68   1.34   5.90
dm-1              0.00     0.00    0.00  346.00     0.00  2768.00     8.00     1.28    3.69    0.00    3.69   0.17   5.90

12/09/2016 01:58:03 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          46.89    0.00    6.55    0.00    0.00   46.55

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    10.00    0.00   18.00     0.00   224.00    12.44     0.06    3.11    0.00    3.11   2.89   5.20
dm-1              0.00     0.00    0.00   28.00     0.00   224.00     8.00     0.07    2.50    0.00    2.50   1.86   5.20

12/09/2016 01:58:04 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.51    0.00    5.53    0.17    0.00   59.80

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00   14.00     0.00   176.00    12.57     0.02    1.43    0.00    1.43   1.00   1.40
dm-1              0.00     0.00    0.00   22.00     0.00   176.00     8.00     0.03    1.27    0.00    1.27   0.64   1.40

12/09/2016 01:58:05 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          52.19    0.00    8.42    1.35    0.00   38.05

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   150.00   60.00  655.00   480.00  6448.00     9.69     2.38    3.32    0.62    3.57   0.64  46.10
dm-1              0.00     0.00   60.00  809.00   480.00  6472.00     8.00     2.93    3.36    0.62    3.57   0.53  46.20

12/09/2016 01:58:06 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          38.32    0.00    6.89    0.17    0.00   54.62

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    52.00   16.00  169.00   128.00  1768.00    10.25     0.50    2.72    0.44    2.93   0.83  15.40
dm-1              0.00     0.00   16.00  218.00   128.00  1744.00     8.00     0.70    2.98    0.38    3.17   0.65  15.30

12/09/2016 01:58:07 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          46.45    0.00    7.26    0.34    0.00   45.95

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  3879.00    0.00   89.00     0.00 31752.00   356.76     1.06   11.90    0.00   11.90   0.54   4.80
dm-1              0.00     0.00    0.00 3969.00     0.00 31752.00     8.00    79.12   19.94    0.00   19.94   0.01   4.80

12/09/2016 01:58:08 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          47.48    0.00    7.05    1.51    0.00   43.96

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    80.00    0.00   36.00     0.00   928.00    25.78     0.14    3.81    0.00    3.81   3.58  12.90
dm-1              0.00     0.00    0.00  116.00     0.00   928.00     8.00     0.55    4.77    0.00    4.77   1.11  12.90

12/09/2016 01:58:09 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          32.38    0.00    5.06    0.00    0.00   62.56

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00    6.00     0.00   112.00    18.67     0.01    1.00    0.00    1.00   1.00   0.60
dm-1              0.00     0.00    0.00   14.00     0.00   112.00     8.00     0.01    1.00    0.00    1.00   0.43   0.60

12/09/2016 01:58:10 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          28.62    0.00    6.73    0.51    0.00   64.14

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  9047.00    0.00  191.00     0.00 73928.00   387.06     1.98   10.36    0.00   10.36   0.32   6.10
dm-1              0.00     0.00    0.00 9241.00     0.00 73928.00     8.00   148.26   16.04    0.00   16.04   0.01   6.10

12/09/2016 01:58:11 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          65.83    0.00    7.04    0.17    0.00   26.97

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    18.00    0.00   32.00     0.00   400.00    12.50     0.04    1.19    0.00    1.19   0.91   2.90
dm-1              0.00     0.00    0.00   50.00     0.00   400.00     8.00     0.06    1.18    0.00    1.18   0.60   3.00

12/09/2016 01:58:12 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.87    0.00    5.91    0.17    0.00   66.05

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     9.00    0.00   11.00     0.00   160.00    14.55     0.01    1.09    0.00    1.09   1.00   1.10
dm-1              0.00     0.00    0.00   20.00     0.00   160.00     8.00     0.02    1.10    0.00    1.10   0.55   1.10

12/09/2016 01:58:13 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          39.36    0.00    6.03    0.00    0.00   54.61

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     6.00    0.00   12.00     0.00   144.00    12.00     0.01    1.08    0.00    1.08   0.83   1.00
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.06    0.00    1.06   0.56   1.00

12/09/2016 01:58:14 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          29.97    0.00    5.56    0.17    0.00   64.31

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    11.00    0.00   13.00     0.00   192.00    14.77     0.01    0.85    0.00    0.85   0.69   0.90
dm-1              0.00     0.00    0.00   24.00     0.00   192.00     8.00     0.02    0.83    0.00    0.83   0.38   0.90

12/09/2016 01:58:15 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.99    0.00    5.73    0.17    0.00   66.10

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   596.00    0.00   41.00     0.00  5096.00   124.29     0.20    4.76    0.00    4.76   0.51   2.10
dm-1              0.00     0.00    0.00  637.00     0.00  5096.00     8.00     4.20    6.59    0.00    6.59   0.03   2.10

12/09/2016 01:58:16 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          49.58    0.00    6.53    0.00    0.00   43.89

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00   17.00     0.00   192.00    11.29     0.02    0.94    0.00    0.94   0.71   1.20
dm-1              0.00     0.00    0.00   24.00     0.00   192.00     8.00     0.02    0.96    0.00    0.96   0.50   1.20

12/09/2016 01:58:17 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.46    0.00    5.57    0.00    0.00   59.97

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00   16.00     0.00   192.00    12.00     0.02    1.19    0.00    1.19   0.94   1.50
dm-1              0.00     0.00    0.00   24.00     0.00   192.00     8.00     0.03    1.25    0.00    1.25   0.62   1.50

12/09/2016 01:58:18 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          46.41    0.00    7.35    0.17    0.00   46.08

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    11.00    0.00   13.00     0.00   192.00    14.77     0.01    0.38    0.00    0.38   0.38   0.50
dm-1              0.00     0.00    0.00   24.00     0.00   192.00     8.00     0.01    0.50    0.00    0.50   0.21   0.50

12/09/2016 01:58:19 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          32.32    0.00    5.56    0.00    0.00   62.12

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00   11.00     0.00   144.00    13.09     0.01    1.27    0.00    1.27   1.09   1.20
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.28    0.00    1.28   0.67   1.20

12/09/2016 01:58:20 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          23.74    0.00    5.22    0.67    0.00   70.37

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7168.00    0.00  108.00     0.00 58208.00   538.96     1.39   12.86    0.00   12.86   0.54   5.80
dm-1              0.00     0.00    0.00 7276.00     0.00 58208.00     8.00   154.85   21.28    0.00   21.28   0.01   5.80

12/09/2016 01:58:21 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          58.05    0.00    8.05    1.17    0.00   32.72

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   142.00  113.00  561.00   904.00  5624.00     9.69     1.73    2.56    0.78    2.92   0.82  55.00
dm-1              0.00     0.00  113.00  703.00   904.00  5624.00     8.00     2.15    2.63    0.78    2.93   0.67  55.00

12/09/2016 01:58:22 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          48.31    0.00    7.09    0.51    0.00   44.09

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    16.00    0.00   18.00     0.00   264.00    14.67     0.11    1.06    0.00    1.06   3.94   7.10
dm-1              0.00     0.00    0.00   36.00     0.00   288.00     8.00     0.18    0.94    0.00    0.94   1.97   7.10

12/09/2016 01:58:23 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          36.82    0.00    7.94    0.51    0.00   54.73

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    41.00    0.00   27.00     0.00   552.00    20.44     0.12    7.89    0.00    7.89   2.67   7.20
dm-1              0.00     0.00    0.00   66.00     0.00   528.00     8.00     0.31    6.94    0.00    6.94   1.11   7.30

12/09/2016 01:58:24 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          29.46    0.00    5.39    0.00    0.00   65.15

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     4.00    0.00    6.00     0.00    80.00    13.33     0.01    1.00    0.00    1.00   0.83   0.50
dm-1              0.00     0.00    0.00   10.00     0.00    80.00     8.00     0.01    1.00    0.00    1.00   0.50   0.50

12/09/2016 01:58:25 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          32.44    0.00    5.88    0.34    0.00   61.34

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  1638.00    0.00  124.00     0.00 14096.00   113.68     0.78    6.32    0.00    6.32   0.35   4.30
dm-1              0.00     0.00    0.00 1762.00     0.00 14096.00     8.00    21.02   11.93    0.00   11.93   0.02   4.30

12/09/2016 01:58:26 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          35.53    0.00    5.75    0.00    0.00   58.71

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     5.94    0.00    9.90     0.00   126.73    12.80     0.01    0.80    0.00    0.80   0.70   0.69
dm-1              0.00     0.00    0.00   15.84     0.00   126.73     8.00     0.01    0.88    0.00    0.88   0.44   0.69

12/09/2016 01:58:27 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          36.30    0.00    5.88    0.17    0.00   57.65

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     5.00    0.00   13.00     0.00   144.00    11.08     0.01    0.77    0.00    0.77   0.46   0.60
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.01    0.83    0.00    0.83   0.39   0.70

12/09/2016 01:58:28 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          18.41    0.00    4.90    0.00    0.00   76.69

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     4.00    0.00    4.00     0.00    64.00    16.00     0.01    1.50    0.00    1.50   1.50   0.60
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    1.50    0.00    1.50   0.75   0.60

12/09/2016 01:58:29 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          23.06    0.00    4.88    0.00    0.00   72.05

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     3.00    0.00    5.00     0.00    64.00    12.80     0.00    0.80    0.00    0.80   0.80   0.40
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    0.88    0.00    0.88   0.50   0.40

12/09/2016 01:58:30 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          25.67    0.00    6.54    0.84    0.00   66.95

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7224.00    0.00  458.00     0.00 60832.00   132.82     6.34   12.02    0.00   12.02   0.20   9.00
dm-1              0.00     0.00    0.00 7891.00     0.00 63128.00     8.00   148.37   18.63    0.00   18.63   0.01   9.00

12/09/2016 01:58:31 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          53.38    0.00    6.08    0.68    0.00   39.86

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  1168.00    0.00  970.00     0.00 17728.00    18.28    12.83   14.08    0.00   14.08   0.12  11.50
dm-1              0.00     0.00    0.00 1929.00     0.00 15432.00     8.00    30.07   16.31    0.00   16.31   0.06  11.50

12/09/2016 01:58:32 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          37.19    0.00    6.87    0.17    0.00   55.78

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    12.00    0.00   24.00     0.00   288.00    12.00     0.02    0.92    0.00    0.92   0.75   1.80
dm-1              0.00     0.00    0.00   36.00     0.00   288.00     8.00     0.04    0.97    0.00    0.97   0.50   1.80

12/09/2016 01:58:33 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          40.54    0.00    6.03    0.67    0.00   52.76

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    10.00    0.00   18.00     0.00   224.00    12.44     0.08    4.61    0.00    4.61   4.39   7.90
dm-1              0.00     0.00    0.00   28.00     0.00   224.00     8.00     0.16    5.61    0.00    5.61   2.82   7.90

12/09/2016 01:58:34 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          21.51    0.00    5.55    0.00    0.00   72.94

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     2.00    0.00    2.00     0.00    32.00    16.00     0.00    1.50    0.00    1.50   1.50   0.30
dm-1              0.00     0.00    0.00    4.00     0.00    32.00     8.00     0.01    1.50    0.00    1.50   0.75   0.30

12/09/2016 01:58:35 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          33.05    0.00    5.56    0.17    0.00   61.21

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   871.00    0.00   29.00     0.00  7200.00   248.28     0.10    3.38    0.00    3.38   0.79   2.30
dm-1              0.00     0.00    0.00  900.00     0.00  7200.00     8.00     5.32    5.91    0.00    5.91   0.03   2.30

12/09/2016 01:58:36 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.79    0.00    6.89   15.13    0.00   43.19

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   143.00    0.00 1669.00     0.00 14472.00     8.67   133.01   60.12    0.00   60.12   0.55  91.70
dm-1              0.00     0.00    2.00 1968.00    16.00 15744.00     8.00   140.68   54.38    0.00   54.44   0.47  91.70

12/09/2016 01:58:37 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          33.11    0.00   10.87   16.13    0.00   39.90

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   349.00   51.00 3909.00   408.00 34032.00     8.70   115.45   37.40   11.06   37.75   0.25  97.70
dm-1              0.00     0.00   50.00 4108.00   400.00 32864.00     8.00   124.51   38.00   11.28   38.32   0.23  97.70

12/09/2016 01:58:38 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          48.47    0.00    9.49    0.68    0.00   41.36

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   112.00   34.00  370.00   272.00  3912.00    10.36     0.93    2.36    0.47    2.54   0.89  35.90
dm-1              0.00     0.00   33.00  476.00   264.00  3808.00     8.00     1.90    3.83    0.48    4.07   0.71  35.90

12/09/2016 01:58:39 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          38.82    0.00    8.40    0.50    0.00   52.27

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00   15.00     0.00   184.00    12.27     0.07    4.33    0.00    4.33   4.00   6.00
dm-1              0.00     0.00    0.00   23.00     0.00   184.00     8.00     0.08    3.43    0.00    3.43   2.61   6.00

12/09/2016 01:58:40 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.99    0.00    5.90    0.67    0.00   65.43

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  9003.00    0.00  128.00     0.00 73048.00   570.69     1.31   10.27    0.00   10.27   0.52   6.70
dm-1              0.00     0.00    0.00 9131.00     0.00 73048.00     8.00   135.00   14.78    0.00   14.78   0.01   6.70

12/09/2016 01:58:41 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          65.83    0.00    6.87    0.17    0.00   27.14

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    18.00    0.00   28.00     0.00   368.00    13.14     0.03    1.14    0.00    1.14   0.96   2.70
dm-1              0.00     0.00    0.00   46.00     0.00   368.00     8.00     0.06    1.20    0.00    1.20   0.61   2.80

12/09/2016 01:58:42 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          28.24    0.00    6.55    0.17    0.00   65.04

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  1083.00    0.00   80.00     0.00  9312.00   116.40     0.29    3.65    0.00    3.65   0.28   2.20
dm-1              0.00     0.00    0.00 1164.00     0.00  9312.00     8.00     6.22    5.34    0.00    5.34   0.02   2.20

12/09/2016 01:58:43 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          44.30    0.00    7.89    0.17    0.00   47.65

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    13.00    0.00   28.00     0.00   328.00    11.71     0.04    1.32    0.00    1.32   1.00   2.80
dm-1              0.00     0.00    0.00   41.00     0.00   328.00     8.00     0.05    1.27    0.00    1.27   0.68   2.80

12/09/2016 01:58:44 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          28.76    0.00    4.18    0.17    0.00   66.89

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00   10.00     0.00   144.00    14.40     0.01    1.30    0.00    1.30   1.10   1.10
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.28    0.00    1.28   0.61   1.10

12/09/2016 01:58:45 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          39.09    0.00    5.37    0.17    0.00   55.37

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    67.00    0.00   19.00     0.00   688.00    36.21     0.02    1.05    0.00    1.05   0.79   1.50
dm-1              0.00     0.00    0.00   86.00     0.00   688.00     8.00     0.21    2.43    0.00    2.43   0.17   1.50

12/09/2016 01:58:46 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          32.89    0.00    4.36    0.17    0.00   62.58

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00    8.00     0.00   128.00    16.00     0.03    3.12    0.00    3.12   3.12   2.50
dm-1              0.00     0.00    0.00   16.00     0.00   128.00     8.00     0.05    3.12    0.00    3.12   1.56   2.50

12/09/2016 01:58:47 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          42.95    0.00    5.03    0.50    0.00   51.51

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    11.00    0.00   27.00     0.00   304.00    11.26     0.07    2.70    0.00    2.70   1.89   5.10
dm-1              0.00     0.00    0.00   38.00     0.00   304.00     8.00     0.11    2.92    0.00    2.92   1.34   5.10

12/09/2016 01:58:48 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          35.91    0.00    5.70    0.17    0.00   58.22

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    12.00    0.00   13.00     0.00   200.00    15.38     0.02    1.38    0.00    1.38   1.31   1.70
dm-1              0.00     0.00    0.00   25.00     0.00   200.00     8.00     0.03    1.36    0.00    1.36   0.68   1.70

12/09/2016 01:58:49 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          28.81    0.00    5.70    0.00    0.00   65.49

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     3.00    0.00    5.00     0.00    64.00    12.80     0.01    1.00    0.00    1.00   0.80   0.40
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    1.00    0.00    1.00   0.50   0.40

12/09/2016 01:58:50 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          41.85    0.00    5.88    0.50    0.00   51.76

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7035.00    0.00   86.00     0.00 56968.00   662.42     1.09   12.70    0.00   12.70   0.67   5.80
dm-1              0.00     0.00    0.00 7121.00     0.00 56968.00     8.00   127.29   17.88    0.00   17.88   0.01   5.80

12/09/2016 01:58:51 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          51.09    0.00    6.20    0.34    0.00   42.38

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    11.00    0.00   23.00     0.00   272.00    11.83     0.03    1.35    0.00    1.35   1.00   2.30
dm-1              0.00     0.00    0.00   34.00     0.00   272.00     8.00     0.05    1.56    0.00    1.56   0.74   2.50

12/09/2016 01:58:52 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          41.62    0.00    4.40    2.71    0.00   51.27

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   778.00    0.00 1600.00     0.00 18440.00    11.53    34.26   17.70    0.00   17.70   0.14  22.60
dm-1              0.00     0.00    0.00 2663.00     0.00 21304.00     8.00    42.82   12.92    0.00   12.92   0.08  22.60

12/09/2016 01:58:53 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          48.74    0.00    7.04    3.52    0.00   40.70

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   445.00   84.00 2865.00   672.00 27064.00     9.41    35.92   14.20    0.79   14.59   0.26  77.50
dm-1              0.00     0.00   84.00 3025.00   672.00 24200.00     8.00    41.45   15.99    0.79   16.41   0.25  77.50

12/09/2016 01:58:54 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          23.32    0.00    3.36    0.00    0.00   73.32

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     2.00    0.00    6.00     0.00    64.00    10.67     0.00    0.67    0.00    0.67   0.50   0.30
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    0.75    0.00    0.75   0.38   0.30

12/09/2016 01:58:55 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          30.08    0.00    4.87    0.00    0.00   65.04

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     9.00    0.00    9.00     0.00   144.00    16.00     0.01    1.00    0.00    1.00   0.78   0.70
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.00    0.00    1.00   0.39   0.70

12/09/2016 01:58:56 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          35.80    0.00    4.20    0.17    0.00   59.83

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     9.00    0.00    9.00     0.00   144.00    16.00     0.01    1.00    0.00    1.00   1.00   0.90
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.00    0.00    1.00   0.50   0.90

12/09/2016 01:58:57 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          38.99    0.00    5.55    0.34    0.00   55.13

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  1791.00    0.00   45.00     0.00 14688.00   326.40     0.29    6.38    0.00    6.38   0.93   4.20
dm-1              0.00     0.00    0.00 1836.00     0.00 14688.00     8.00    25.02   13.63    0.00   13.63   0.02   4.20

12/09/2016 01:58:58 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          35.34    0.00    4.02    0.00    0.00   60.64

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    39.00    0.00   61.00     0.00   800.00    13.11     0.20    3.26    0.00    3.26   0.34   2.10
dm-1              0.00     0.00    0.00  100.00     0.00   800.00     8.00     0.40    3.98    0.00    3.98   0.21   2.10

12/09/2016 01:58:59 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          20.71    0.00    4.04    0.00    0.00   75.25

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     2.00    0.00    2.00     0.00    32.00    16.00     0.00    0.50    0.00    0.50   0.50   0.10
dm-1              0.00     0.00    0.00    4.00     0.00    32.00     8.00     0.00    0.50    0.00    0.50   0.25   0.10

12/09/2016 01:59:00 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          45.47    0.00    8.05    0.50    0.00   45.97

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  7033.00    0.00   83.00     0.00 56928.00   685.88     1.07   12.87    0.00   12.87   0.67   5.60
dm-1              0.00     0.00    0.00 7116.00     0.00 56928.00     8.00   124.66   17.52    0.00   17.52   0.01   5.60

12/09/2016 01:59:01 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          64.65    0.00    6.06    0.51    0.00   28.79

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    12.00    0.00   24.00     0.00   288.00    12.00     0.11    4.50    0.00    4.50   4.33  10.40
dm-1              0.00     0.00    0.00   36.00     0.00   288.00     8.00     0.20    5.44    0.00    5.44   2.89  10.40

12/09/2016 01:59:02 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          54.36    0.00   12.75    0.17    0.00   32.72

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   128.00    0.00   67.00     0.00  1560.00    23.28     0.08    1.21    0.00    1.21   0.84   5.60
dm-1              0.00     0.00    0.00  195.00     0.00  1560.00     8.00     0.35    1.80    0.00    1.80   0.29   5.60

12/09/2016 01:59:03 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.52    0.00    5.70    0.17    0.00   66.61

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    10.00    0.00   17.00     0.00   216.00    12.71     0.02    0.94    0.00    0.94   0.65   1.10
dm-1              0.00     0.00    0.00   27.00     0.00   216.00     8.00     0.03    1.00    0.00    1.00   0.41   1.10

12/09/2016 01:59:04 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          38.46    0.00    6.52    0.00    0.00   55.02

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     9.00    0.00   17.00     0.00   208.00    12.24     0.01    0.82    0.00    0.82   0.59   1.00
dm-1              0.00     0.00    0.00   26.00     0.00   208.00     8.00     0.02    0.85    0.00    0.85   0.42   1.10

12/09/2016 01:59:05 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.85    0.00    5.03    0.17    0.00   66.95

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     5.00    0.00    3.00     0.00    64.00    21.33     0.00    1.00    0.00    1.00   1.00   0.30
dm-1              0.00     0.00    0.00    8.00     0.00    64.00     8.00     0.01    1.00    0.00    1.00   0.38   0.30

12/09/2016 01:59:06 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          40.77    0.00    6.38    0.00    0.00   52.85

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00    9.00     0.00   128.00    14.22     0.01    0.67    0.00    0.67   0.67   0.60
dm-1              0.00     0.00    0.00   16.00     0.00   128.00     8.00     0.01    0.75    0.00    0.75   0.38   0.60

12/09/2016 01:59:07 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          37.08    0.00    4.87    0.17    0.00   57.89

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   614.00    0.00   80.00     0.00  5552.00    69.40     0.43    5.36    0.00    5.36   0.28   2.20
dm-1              0.00     0.00    0.00  694.00     0.00  5552.00     8.00     5.70    8.22    0.00    8.22   0.03   2.20

12/09/2016 01:59:08 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          49.25    0.00    7.87    9.21    0.00   33.67

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  2660.00   10.00 7559.00    80.00 81752.00    10.81   100.41   13.27    0.50   13.28   0.10  78.90
dm-1              0.00     0.00   10.00 10221.00    80.00 81768.00     8.00   142.46   13.92    0.50   13.94   0.08  78.90

12/09/2016 01:59:09 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          30.13    0.00    6.57    0.84    0.00   62.46

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   232.00  101.00  695.00   808.00  7416.00    10.33     2.18    2.75    0.65    3.05   0.83  65.80
dm-1              0.00     0.00  101.00  925.00   808.00  7400.00     8.00     3.03    2.96    0.65    3.21   0.64  65.80

12/09/2016 01:59:10 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          34.00    0.00    6.53    0.67    0.00   58.79

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  9086.00    0.00   98.00     0.00 73472.00   749.71     1.29   13.12    0.00   13.12   0.67   6.60
dm-1              0.00     0.00    0.00 9184.00     0.00 73472.00     8.00   151.72   16.52    0.00   16.52   0.01   6.60

12/09/2016 01:59:11 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          42.88    0.00    4.19    0.17    0.00   52.76

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     8.00    0.00   18.00     0.00   208.00    11.56     0.01    0.83    0.00    0.83   0.61   1.10
dm-1              0.00     0.00    0.00   26.00     0.00   208.00     8.00     0.02    0.85    0.00    0.85   0.42   1.10

12/09/2016 01:59:12 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          28.45    0.00    5.22    0.00    0.00   66.33

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     6.00    0.00    9.00     0.00   120.00    13.33     0.02    1.78    0.00    1.78   1.56   1.40
dm-1              0.00     0.00    0.00   15.00     0.00   120.00     8.00     0.03    1.67    0.00    1.67   0.93   1.40

12/09/2016 01:59:13 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          28.02    0.00    3.86    0.00    0.00   68.12

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     4.00    0.00   19.00     0.00   184.00     9.68     0.02    1.00    0.00    1.00   0.47   0.90
dm-1              0.00     0.00    0.00   23.00     0.00   184.00     8.00     0.02    1.00    0.00    1.00   0.39   0.90

12/09/2016 01:59:14 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          36.85    0.00    6.37    0.17    0.00   56.62

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00   15.00     0.00   176.00    11.73     0.01    0.87    0.00    0.87   0.67   1.00
dm-1              0.00     0.00    0.00   22.00     0.00   176.00     8.00     0.02    0.86    0.00    0.86   0.45   1.00

12/09/2016 01:59:15 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          23.95    0.00    4.02    0.17    0.00   71.86

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00  1693.00    0.00   76.00     0.00 14152.00   186.21     0.49    6.51    0.00    6.51   0.25   1.90
dm-1              0.00     0.00    0.00 1769.00     0.00 14152.00     8.00    15.75    8.91    0.00    8.91   0.01   1.90

12/09/2016 01:59:16 PM
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          41.44    0.00    6.04    0.00    0.00   52.52

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     7.00    0.00   11.00     0.00   144.00    13.09     0.01    1.09    0.00    1.09   0.91   1.00
dm-1              0.00     0.00    0.00   18.00     0.00   144.00     8.00     0.02    1.17    0.00    1.17   0.61   1.10

It seems like dm-0 (swap) has no activity anymore which should be a good thing. But as the problem is still there... I would like to say once more that imho this is a Nagios problem. I can see several types of solutions to tackle this problem. For example put a flag somewhere when the apply configuration is started. on a refresh of the open service problems and other views, check if the 'apply flag' is there and if so just show no hosts at all. At the final end of the apply process the flag should be rmeoved after which the hosts and services are showing again.

Could you please discuss this idea with a dev and see if this is doable. We rather have a long apply time with no hosts and services showing then a long apply time with all kinds of false positives.

Thanks.

Willem

[avandemore]

I spoke with a dev yesterday on pretty much your proposed solution. We'll see were it goes.

I have created FR 10391 for this issue. You can inquire here or via ticket its status.