Disk I/O for all Multipath devices
-
yunushaikh
- Posts: 176
- Joined: Sat Jun 20, 2015 9:04 pm
Disk I/O for all Multipath devices
Hello Experts,
I opened the below thread for monitoring of Disk I/O for all the disk at a time in single command.
https://support.nagios.com/forum/viewto ... =7&t=33595
This works pretty well. Problem I am facing is I have multipath devices and there are lot of disks attached to the server so it is pulling all the info for Disk I/O
I only need to pull multipath devices
My multipath devices are
/dev/mapper/mpathap1
/dev/mapper/mpathbp1
/dev/mapper/mpathcp1
/dev/mapper/mpathdp1
/dev/mapper/mpathep1
/dev/mapper/mpathfp1
and No of disks which are getting monitored are
DISKIO OK - sdh - No Problems found (Write 0 MB/s)
DISKIO OK - sdb - No Problems found (Write 0 MB/s)
DISKIO OK - sda - No Problems found (Write 0 MB/s)
DISKIO OK - sdd - No Problems found (Write 0 MB/s)
DISKIO OK - sde - No Problems found (Write 0 MB/s)
DISKIO OK - sdg - No Problems found (Write 0 MB/s)
DISKIO OK - sdc - No Problems found (Write 0 MB/s)
DISKIO OK - sdf - No Problems found (Write 0 MB/s)
DISKIO OK - sdi - No Problems found (Write 0 MB/s)
DISKIO OK - sdj - No Problems found (Write 0 MB/s)
DISKIO OK - sdk - No Problems found (Write 0 MB/s)
DISKIO OK - sdl - No Problems found (Write 0 MB/s)
DISKIO OK - sdn - No Problems found (Write 0 MB/s)
DISKIO OK - sdo - No Problems found (Write 0 MB/s)
DISKIO OK - sdq - No Problems found (Write 0 MB/s)
DISKIO OK - sdp - No Problems found (Write 0 MB/s)
DISKIO OK - sdr - No Problems found (Write 0 MB/s)
DISKIO OK - sds - No Problems found (Write 0 MB/s)
DISKIO OK - sdt - No Problems found (Write 0 MB/s)
DISKIO OK - sdu - No Problems found (Write 0 MB/s)
DISKIO OK - sdv - No Problems found (Write 0 MB/s)
DISKIO OK - sdw - No Problems found (Write 0 MB/s)
DISKIO OK - sdab - No Problems found (Write 0 MB/s)
DISKIO OK - sdac - No Problems found (Write 0 MB/s)
DISKIO OK - sdaa - No Problems found (Write 0 MB/s)
DISKIO OK - sdy - No Problems found (Write 0 MB/s)
DISKIO OK - sdad - No Problems found (Write 0 MB/s)
DISKIO OK - sdx - No Problems found (Write 0 MB/s)
DISKIO OK - sdz - No Problems found (Write 0 MB/s)
DISKIO OK - sdaj - No Problems found (Write 0 MB/s)
DISKIO OK - sdae - No Problems found (Write 0 MB/s)
DISKIO OK - sdak - No Problems found (Write 0 MB/s)
DISKIO OK - sdaf - No Problems found (Write 0 MB/s)
DISKIO OK - sdah - No Problems found (Write 0 MB/s)
DISKIO OK - sdai - No Problems found (Write 0 MB/s)
DISKIO OK - sdag - No Problems found (Write 0 MB/s)
DISKIO OK - sdal - No Problems found (Write 0 MB/s)
DISKIO OK - sdam - No Problems found (Write 0 MB/s)
DISKIO OK - sdao - No Problems found (Write 0 MB/s)
DISKIO OK - sdap - No Problems found (Write 0 MB/s)
DISKIO OK - sdaq - No Problems found (Write 0 MB/s)
DISKIO OK - sdar - No Problems found (Write 0 MB/s)
DISKIO OK - sdan - No Problems found (Write 0 MB/s)
DISKIO OK - sdas - No Problems found (Write 0 MB/s)
DISKIO OK - sdat - No Problems found (Write 0 MB/s)
DISKIO OK - sdau - No Problems found (Write 0 MB/s)
DISKIO OK - sdav - No Problems found (Write 0 MB/s)
DISKIO OK - sdaw - No Problems found (Write 0 MB/s)
DISKIO OK - sdax - No Problems found (Write 0 MB/s)
DISKIO OK - sday - No Problems found (Write 0 MB/s)
DISKIO OK - sdaz - No Problems found (Write 0 MB/s)
DISKIO OK - sdba - No Problems found (Write 0 MB/s)
DISKIO OK - sdbb - No Problems found (Write 0 MB/s)
DISKIO OK - sdbc - No Problems found (Write 0 MB/s)
DISKIO OK - sdbe - No Problems found (Write 0 MB/s)
DISKIO OK - sdbd - No Problems found (Write 0 MB/s)
DISKIO OK - sdbf - No Problems found (Write 0 MB/s)
Is there any solution or plugin which will monitor multipath device. Thanks in advance
I opened the below thread for monitoring of Disk I/O for all the disk at a time in single command.
https://support.nagios.com/forum/viewto ... =7&t=33595
This works pretty well. Problem I am facing is I have multipath devices and there are lot of disks attached to the server so it is pulling all the info for Disk I/O
I only need to pull multipath devices
My multipath devices are
/dev/mapper/mpathap1
/dev/mapper/mpathbp1
/dev/mapper/mpathcp1
/dev/mapper/mpathdp1
/dev/mapper/mpathep1
/dev/mapper/mpathfp1
and No of disks which are getting monitored are
DISKIO OK - sdh - No Problems found (Write 0 MB/s)
DISKIO OK - sdb - No Problems found (Write 0 MB/s)
DISKIO OK - sda - No Problems found (Write 0 MB/s)
DISKIO OK - sdd - No Problems found (Write 0 MB/s)
DISKIO OK - sde - No Problems found (Write 0 MB/s)
DISKIO OK - sdg - No Problems found (Write 0 MB/s)
DISKIO OK - sdc - No Problems found (Write 0 MB/s)
DISKIO OK - sdf - No Problems found (Write 0 MB/s)
DISKIO OK - sdi - No Problems found (Write 0 MB/s)
DISKIO OK - sdj - No Problems found (Write 0 MB/s)
DISKIO OK - sdk - No Problems found (Write 0 MB/s)
DISKIO OK - sdl - No Problems found (Write 0 MB/s)
DISKIO OK - sdn - No Problems found (Write 0 MB/s)
DISKIO OK - sdo - No Problems found (Write 0 MB/s)
DISKIO OK - sdq - No Problems found (Write 0 MB/s)
DISKIO OK - sdp - No Problems found (Write 0 MB/s)
DISKIO OK - sdr - No Problems found (Write 0 MB/s)
DISKIO OK - sds - No Problems found (Write 0 MB/s)
DISKIO OK - sdt - No Problems found (Write 0 MB/s)
DISKIO OK - sdu - No Problems found (Write 0 MB/s)
DISKIO OK - sdv - No Problems found (Write 0 MB/s)
DISKIO OK - sdw - No Problems found (Write 0 MB/s)
DISKIO OK - sdab - No Problems found (Write 0 MB/s)
DISKIO OK - sdac - No Problems found (Write 0 MB/s)
DISKIO OK - sdaa - No Problems found (Write 0 MB/s)
DISKIO OK - sdy - No Problems found (Write 0 MB/s)
DISKIO OK - sdad - No Problems found (Write 0 MB/s)
DISKIO OK - sdx - No Problems found (Write 0 MB/s)
DISKIO OK - sdz - No Problems found (Write 0 MB/s)
DISKIO OK - sdaj - No Problems found (Write 0 MB/s)
DISKIO OK - sdae - No Problems found (Write 0 MB/s)
DISKIO OK - sdak - No Problems found (Write 0 MB/s)
DISKIO OK - sdaf - No Problems found (Write 0 MB/s)
DISKIO OK - sdah - No Problems found (Write 0 MB/s)
DISKIO OK - sdai - No Problems found (Write 0 MB/s)
DISKIO OK - sdag - No Problems found (Write 0 MB/s)
DISKIO OK - sdal - No Problems found (Write 0 MB/s)
DISKIO OK - sdam - No Problems found (Write 0 MB/s)
DISKIO OK - sdao - No Problems found (Write 0 MB/s)
DISKIO OK - sdap - No Problems found (Write 0 MB/s)
DISKIO OK - sdaq - No Problems found (Write 0 MB/s)
DISKIO OK - sdar - No Problems found (Write 0 MB/s)
DISKIO OK - sdan - No Problems found (Write 0 MB/s)
DISKIO OK - sdas - No Problems found (Write 0 MB/s)
DISKIO OK - sdat - No Problems found (Write 0 MB/s)
DISKIO OK - sdau - No Problems found (Write 0 MB/s)
DISKIO OK - sdav - No Problems found (Write 0 MB/s)
DISKIO OK - sdaw - No Problems found (Write 0 MB/s)
DISKIO OK - sdax - No Problems found (Write 0 MB/s)
DISKIO OK - sday - No Problems found (Write 0 MB/s)
DISKIO OK - sdaz - No Problems found (Write 0 MB/s)
DISKIO OK - sdba - No Problems found (Write 0 MB/s)
DISKIO OK - sdbb - No Problems found (Write 0 MB/s)
DISKIO OK - sdbc - No Problems found (Write 0 MB/s)
DISKIO OK - sdbe - No Problems found (Write 0 MB/s)
DISKIO OK - sdbd - No Problems found (Write 0 MB/s)
DISKIO OK - sdbf - No Problems found (Write 0 MB/s)
Is there any solution or plugin which will monitor multipath device. Thanks in advance
- Box293
- Too Basu
- Posts: 5126
- Joined: Sun Feb 07, 2010 10:55 pm
- Location: Deniliquin, Australia
- Contact:
Re: Disk I/O for all Multipath devices
Is the plugin currently reporting on multipath devices or is it only the disks you've listed here:
https://exchange.nagios.org/directory/P ... th/details
https://exchange.nagios.org/directory/P ... pl/details
Have you tried these plugins:yunushaikh wrote:and No of disks which are getting monitored are
DISKIO OK - sdh - No Problems found (Write 0 MB/s)
DISKIO OK - sdb - No Problems found (Write 0 MB/s)
DISKIO OK - sda - No Problems found (Write 0 MB/s)
DISKIO OK - sdd - No Problems found (Write 0 MB/s)
DISKIO OK - sde - No Problems found (Write 0 MB/s)
DISKIO OK - sdg - No Problems found (Write 0 MB/s)
DISKIO OK - sdc - No Problems found (Write 0 MB/s)
DISKIO OK - sdf - No Problems found (Write 0 MB/s)
DISKIO OK - sdi - No Problems found (Write 0 MB/s)
DISKIO OK - sdj - No Problems found (Write 0 MB/s)
DISKIO OK - sdk - No Problems found (Write 0 MB/s)
DISKIO OK - sdl - No Problems found (Write 0 MB/s)
DISKIO OK - sdn - No Problems found (Write 0 MB/s)
DISKIO OK - sdo - No Problems found (Write 0 MB/s)
DISKIO OK - sdq - No Problems found (Write 0 MB/s)
DISKIO OK - sdp - No Problems found (Write 0 MB/s)
DISKIO OK - sdr - No Problems found (Write 0 MB/s)
DISKIO OK - sds - No Problems found (Write 0 MB/s)
DISKIO OK - sdt - No Problems found (Write 0 MB/s)
DISKIO OK - sdu - No Problems found (Write 0 MB/s)
DISKIO OK - sdv - No Problems found (Write 0 MB/s)
DISKIO OK - sdw - No Problems found (Write 0 MB/s)
DISKIO OK - sdab - No Problems found (Write 0 MB/s)
DISKIO OK - sdac - No Problems found (Write 0 MB/s)
DISKIO OK - sdaa - No Problems found (Write 0 MB/s)
DISKIO OK - sdy - No Problems found (Write 0 MB/s)
DISKIO OK - sdad - No Problems found (Write 0 MB/s)
DISKIO OK - sdx - No Problems found (Write 0 MB/s)
DISKIO OK - sdz - No Problems found (Write 0 MB/s)
DISKIO OK - sdaj - No Problems found (Write 0 MB/s)
DISKIO OK - sdae - No Problems found (Write 0 MB/s)
DISKIO OK - sdak - No Problems found (Write 0 MB/s)
DISKIO OK - sdaf - No Problems found (Write 0 MB/s)
DISKIO OK - sdah - No Problems found (Write 0 MB/s)
DISKIO OK - sdai - No Problems found (Write 0 MB/s)
DISKIO OK - sdag - No Problems found (Write 0 MB/s)
DISKIO OK - sdal - No Problems found (Write 0 MB/s)
DISKIO OK - sdam - No Problems found (Write 0 MB/s)
DISKIO OK - sdao - No Problems found (Write 0 MB/s)
DISKIO OK - sdap - No Problems found (Write 0 MB/s)
DISKIO OK - sdaq - No Problems found (Write 0 MB/s)
DISKIO OK - sdar - No Problems found (Write 0 MB/s)
DISKIO OK - sdan - No Problems found (Write 0 MB/s)
DISKIO OK - sdas - No Problems found (Write 0 MB/s)
DISKIO OK - sdat - No Problems found (Write 0 MB/s)
DISKIO OK - sdau - No Problems found (Write 0 MB/s)
DISKIO OK - sdav - No Problems found (Write 0 MB/s)
DISKIO OK - sdaw - No Problems found (Write 0 MB/s)
DISKIO OK - sdax - No Problems found (Write 0 MB/s)
DISKIO OK - sday - No Problems found (Write 0 MB/s)
DISKIO OK - sdaz - No Problems found (Write 0 MB/s)
DISKIO OK - sdba - No Problems found (Write 0 MB/s)
DISKIO OK - sdbb - No Problems found (Write 0 MB/s)
DISKIO OK - sdbc - No Problems found (Write 0 MB/s)
DISKIO OK - sdbe - No Problems found (Write 0 MB/s)
DISKIO OK - sdbd - No Problems found (Write 0 MB/s)
DISKIO OK - sdbf - No Problems found (Write 0 MB/s)
https://exchange.nagios.org/directory/P ... th/details
https://exchange.nagios.org/directory/P ... pl/details
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
-
yunushaikh
- Posts: 176
- Joined: Sat Jun 20, 2015 9:04 pm
Re: Disk I/O for all Multipath devices
Plugin is not reporting multipath disk devices. Its only reporting those which I have listed.
I need Disk I/O for all those multipath devices. Will these two plugins which you have provided the link report Disk I/O for multipath?
I need Disk I/O for all those multipath devices. Will these two plugins which you have provided the link report Disk I/O for multipath?
Re: Disk I/O for all Multipath devices
Are they listed if you run it with the -v option?
Code: Select all
/usr/local/nagios/libexec/check_diskio_ucd.pl -H 192.168.4.124 -C public -s 2 -w 50 -c 500 -v-
yunushaikh
- Posts: 176
- Joined: Sat Jun 20, 2015 9:04 pm
Re: Disk I/O for all Multipath devices
No Still it is not showing with -v option I tried to run the command and got the below output
DISKIO OK - sdh - No Problems found (Write 0 MB/s)
DISKIO OK - sdb - No Problems found (Write 0 MB/s)
DISKIO OK - sda - No Problems found (Write 0 MB/s)
DISKIO OK - sdd - No Problems found (Write 0 MB/s)
DISKIO OK - sde - No Problems found (Write 0 MB/s)
DISKIO OK - sdg - No Problems found (Write 0 MB/s)
DISKIO OK - sdc - No Problems found (Write 0 MB/s)
DISKIO OK - sdf - No Problems found (Write 0 MB/s)
DISKIO OK - sdi - No Problems found (Write 0 MB/s)
DISKIO OK - sdj - No Problems found (Write 0 MB/s)
DISKIO OK - sdk - No Problems found (Write 0 MB/s)
DISKIO OK - sdl - No Problems found (Write 0 MB/s)
DISKIO OK - sdn - No Problems found (Write 0 MB/s)
DISKIO OK - sdo - No Problems found (Write 0 MB/s)
DISKIO OK - sdq - No Problems found (Write 0 MB/s)
DISKIO OK - sdp - No Problems found (Write 0 MB/s)
DISKIO OK - sdr - No Problems found (Write 0 MB/s)
DISKIO OK - sds - No Problems found (Write 0 MB/s)
DISKIO OK - sdt - No Problems found (Write 0 MB/s)
DISKIO OK - sdu - No Problems found (Write 0 MB/s)
DISKIO OK - sdv - No Problems found (Write 0 MB/s)
DISKIO OK - sdw - No Problems found (Write 0 MB/s)
DISKIO OK - sdab - No Problems found (Write 0 MB/s)
DISKIO OK - sdac - No Problems found (Write 0 MB/s)
DISKIO OK - sdaa - No Problems found (Write 0 MB/s)
DISKIO OK - sdy - No Problems found (Write 0 MB/s)
DISKIO OK - sdad - No Problems found (Write 0 MB/s)
DISKIO OK - sdx - No Problems found (Write 0 MB/s)
DISKIO OK - sdz - No Problems found (Write 0 MB/s)
DISKIO OK - sdaj - No Problems found (Write 0 MB/s)
DISKIO OK - sdae - No Problems found (Write 0 MB/s)
DISKIO OK - sdak - No Problems found (Write 0 MB/s)
DISKIO OK - sdaf - No Problems found (Write 0 MB/s)
DISKIO OK - sdah - No Problems found (Write 0 MB/s)
DISKIO OK - sdai - No Problems found (Write 0 MB/s)
DISKIO OK - sdag - No Problems found (Write 0 MB/s)
DISKIO OK - sdal - No Problems found (Write 0 MB/s)
DISKIO OK - sdam - No Problems found (Write 0 MB/s)
DISKIO OK - sdao - No Problems found (Write 0 MB/s)
DISKIO OK - sdap - No Problems found (Write 0 MB/s)
DISKIO OK - sdaq - No Problems found (Write 0 MB/s)
DISKIO OK - sdar - No Problems found (Write 0 MB/s)
DISKIO OK - sdan - No Problems found (Write 0 MB/s)
DISKIO OK - sdas - No Problems found (Write 0 MB/s)
DISKIO OK - sdat - No Problems found (Write 0 MB/s)
DISKIO OK - sdau - No Problems found (Write 0 MB/s)
DISKIO OK - sdav - No Problems found (Write 0 MB/s)
DISKIO OK - sdaw - No Problems found (Write 0 MB/s)
DISKIO OK - sdax - No Problems found (Write 0 MB/s)
DISKIO OK - sday - No Problems found (Write 0 MB/s)
DISKIO OK - sdaz - No Problems found (Write 0 MB/s)
DISKIO OK - sdba - No Problems found (Write 0 MB/s)
DISKIO OK - sdbb - No Problems found (Write 0 MB/s)
DISKIO OK - sdbc - No Problems found (Write 0 MB/s)
DISKIO OK - sdbe - No Problems found (Write 0 MB/s)
DISKIO OK - sdbd - No Problems found (Write 0 MB/s)
DISKIO OK - sdbf - No Problems found (Write 0 MB/s)|
DISKIO OK - sdh - No Problems found (Write 0 MB/s)
DISKIO OK - sdb - No Problems found (Write 0 MB/s)
DISKIO OK - sda - No Problems found (Write 0 MB/s)
DISKIO OK - sdd - No Problems found (Write 0 MB/s)
DISKIO OK - sde - No Problems found (Write 0 MB/s)
DISKIO OK - sdg - No Problems found (Write 0 MB/s)
DISKIO OK - sdc - No Problems found (Write 0 MB/s)
DISKIO OK - sdf - No Problems found (Write 0 MB/s)
DISKIO OK - sdi - No Problems found (Write 0 MB/s)
DISKIO OK - sdj - No Problems found (Write 0 MB/s)
DISKIO OK - sdk - No Problems found (Write 0 MB/s)
DISKIO OK - sdl - No Problems found (Write 0 MB/s)
DISKIO OK - sdn - No Problems found (Write 0 MB/s)
DISKIO OK - sdo - No Problems found (Write 0 MB/s)
DISKIO OK - sdq - No Problems found (Write 0 MB/s)
DISKIO OK - sdp - No Problems found (Write 0 MB/s)
DISKIO OK - sdr - No Problems found (Write 0 MB/s)
DISKIO OK - sds - No Problems found (Write 0 MB/s)
DISKIO OK - sdt - No Problems found (Write 0 MB/s)
DISKIO OK - sdu - No Problems found (Write 0 MB/s)
DISKIO OK - sdv - No Problems found (Write 0 MB/s)
DISKIO OK - sdw - No Problems found (Write 0 MB/s)
DISKIO OK - sdab - No Problems found (Write 0 MB/s)
DISKIO OK - sdac - No Problems found (Write 0 MB/s)
DISKIO OK - sdaa - No Problems found (Write 0 MB/s)
DISKIO OK - sdy - No Problems found (Write 0 MB/s)
DISKIO OK - sdad - No Problems found (Write 0 MB/s)
DISKIO OK - sdx - No Problems found (Write 0 MB/s)
DISKIO OK - sdz - No Problems found (Write 0 MB/s)
DISKIO OK - sdaj - No Problems found (Write 0 MB/s)
DISKIO OK - sdae - No Problems found (Write 0 MB/s)
DISKIO OK - sdak - No Problems found (Write 0 MB/s)
DISKIO OK - sdaf - No Problems found (Write 0 MB/s)
DISKIO OK - sdah - No Problems found (Write 0 MB/s)
DISKIO OK - sdai - No Problems found (Write 0 MB/s)
DISKIO OK - sdag - No Problems found (Write 0 MB/s)
DISKIO OK - sdal - No Problems found (Write 0 MB/s)
DISKIO OK - sdam - No Problems found (Write 0 MB/s)
DISKIO OK - sdao - No Problems found (Write 0 MB/s)
DISKIO OK - sdap - No Problems found (Write 0 MB/s)
DISKIO OK - sdaq - No Problems found (Write 0 MB/s)
DISKIO OK - sdar - No Problems found (Write 0 MB/s)
DISKIO OK - sdan - No Problems found (Write 0 MB/s)
DISKIO OK - sdas - No Problems found (Write 0 MB/s)
DISKIO OK - sdat - No Problems found (Write 0 MB/s)
DISKIO OK - sdau - No Problems found (Write 0 MB/s)
DISKIO OK - sdav - No Problems found (Write 0 MB/s)
DISKIO OK - sdaw - No Problems found (Write 0 MB/s)
DISKIO OK - sdax - No Problems found (Write 0 MB/s)
DISKIO OK - sday - No Problems found (Write 0 MB/s)
DISKIO OK - sdaz - No Problems found (Write 0 MB/s)
DISKIO OK - sdba - No Problems found (Write 0 MB/s)
DISKIO OK - sdbb - No Problems found (Write 0 MB/s)
DISKIO OK - sdbc - No Problems found (Write 0 MB/s)
DISKIO OK - sdbe - No Problems found (Write 0 MB/s)
DISKIO OK - sdbd - No Problems found (Write 0 MB/s)
DISKIO OK - sdbf - No Problems found (Write 0 MB/s)|
Re: Disk I/O for all Multipath devices
Those plugins that were posted will only check multipath connections, it doesn't look like they will show IO.
They are not being reported because they are not listed in the snmpd table, I'm not sure if there is a way to get that data or if it's even available via snmp. Does your multipath device vendor offer MIB files that you can use or have any information on where to get that data through SNMP?
You might be able to do an snmpwalk and search for the disks in the resulting text to see if there are any OIDs that provide the data you are looking for:
Or to show the OIDs:
They are not being reported because they are not listed in the snmpd table, I'm not sure if there is a way to get that data or if it's even available via snmp. Does your multipath device vendor offer MIB files that you can use or have any information on where to get that data through SNMP?
You might be able to do an snmpwalk and search for the disks in the resulting text to see if there are any OIDs that provide the data you are looking for:
Code: Select all
snmpwalk -v2c -c public 192.168.4.124:161Code: Select all
snmpwalk -v2c -c public 192.168.4.124:161 -On-
yunushaikh
- Posts: 176
- Joined: Sat Jun 20, 2015 9:04 pm
Re: Disk I/O for all Multipath devices
This is becoming very difficult now.
Since those multipath are at last making paritions. Is it possible with any plugin via snmp to monitor Disk I/O of all the partitions on the servers.
Since those multipath are at last making paritions. Is it possible with any plugin via snmp to monitor Disk I/O of all the partitions on the servers.
-
jdalrymple
- Skynet Drone
- Posts: 2620
- Joined: Wed Feb 11, 2015 1:56 pm
Re: Disk I/O for all Multipath devices
Introducing vendor specific software always makes things difficult.yunushaikh wrote:This is becoming very difficult now.
You need to answer that, or at a minimum tell us what mpio device/driver you're using and we can try to research a bit for ourselves. I can tell you some vendors are great about providing 3rd party access to IO metrics and others are not. At the end of the day though, your SAN vendor and/or IO card vendor is running the show here, we need to get data from there, not the raw disk paths.ssax wrote:Does your multipath device vendor offer MIB files that you can use or have any information on where to get that data through SNMP?
They are? Show us the output of pvdisplay (assuming you're using LVM)yunushaikh wrote:Since those multipath are at last making paritions. Is it possible with any plugin via snmp to monitor Disk I/O of all the partitions on the servers.
-
yunushaikh
- Posts: 176
- Joined: Sat Jun 20, 2015 9:04 pm
Re: Disk I/O for all Multipath devices
Output of PVDisplay :
pvdisplay
/dev/sda: read failed after 0 of 4096 at 0: Input/output error
/dev/sda: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sda: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sda: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdq: read failed after 0 of 4096 at 0: Input/output error
/dev/sdq: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdq: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdq: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdb: read failed after 0 of 4096 at 0: Input/output error
/dev/sdb: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdb: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdb: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdr: read failed after 0 of 4096 at 0: Input/output error
/dev/sdr: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdr: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdr: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdax: read failed after 0 of 4096 at 0: Input/output error
/dev/sdax: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdax: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdax: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdc: read failed after 0 of 4096 at 0: Input/output error
/dev/sdc: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdc: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdc: read failed after 0 of 4096 at 4096: Input/output error
/dev/sds: read failed after 0 of 4096 at 0: Input/output error
/dev/sds: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sds: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sds: read failed after 0 of 4096 at 4096: Input/output error
/dev/sday: read failed after 0 of 4096 at 0: Input/output error
/dev/sday: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sday: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sday: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdd: read failed after 0 of 4096 at 0: Input/output error
/dev/sdd: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdd: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdd: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdt: read failed after 0 of 4096 at 0: Input/output error
/dev/sdt: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdt: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdt: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 4096: Input/output error
/dev/sde: read failed after 0 of 4096 at 0: Input/output error
/dev/sde: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sde: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sde: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdu: read failed after 0 of 4096 at 0: Input/output error
/dev/sdu: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdu: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdu: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdf: read failed after 0 of 4096 at 0: Input/output error
/dev/sdf: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdf: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdf: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdv: read failed after 0 of 4096 at 0: Input/output error
/dev/sdv: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdv: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdv: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdg: read failed after 0 of 4096 at 0: Input/output error
/dev/sdg: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdg: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdg: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdx: read failed after 0 of 4096 at 0: Input/output error
/dev/sdx: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdx: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdx: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdan: read failed after 0 of 4096 at 0: Input/output error
/dev/sdan: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdan: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdan: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdy: read failed after 0 of 4096 at 0: Input/output error
/dev/sdy: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdy: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdy: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdz: read failed after 0 of 4096 at 0: Input/output error
/dev/sdz: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdz: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdz: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdab: read failed after 0 of 4096 at 0: Input/output error
/dev/sdab: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdab: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdab: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdac: read failed after 0 of 4096 at 0: Input/output error
/dev/sdac: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdac: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdac: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdau: read failed after 0 of 4096 at 0: Input/output error
/dev/sdau: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdau: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdau: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdp: read failed after 0 of 4096 at 0: Input/output error
/dev/sdp: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdp: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdp: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdav: read failed after 0 of 4096 at 0: Input/output error
/dev/sdav: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdav: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdav: read failed after 0 of 4096 at 4096: Input/output error
--- Physical volume ---
PV Name /dev/mapper/mpathap2
VG Name vg_XXXXXX
PV Size 49.51 GiB / not usable 3.00 MiB
Allocatable yes (but full)
PE Size 4.00 MiB
Total PE 12674
Free PE 0
Allocated PE 12674
pvdisplay
/dev/sda: read failed after 0 of 4096 at 0: Input/output error
/dev/sda: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sda: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sda: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdq: read failed after 0 of 4096 at 0: Input/output error
/dev/sdq: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdq: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdq: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaw: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdb: read failed after 0 of 4096 at 0: Input/output error
/dev/sdb: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdb: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdb: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdr: read failed after 0 of 4096 at 0: Input/output error
/dev/sdr: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdr: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdr: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdax: read failed after 0 of 4096 at 0: Input/output error
/dev/sdax: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdax: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdax: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdc: read failed after 0 of 4096 at 0: Input/output error
/dev/sdc: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdc: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdc: read failed after 0 of 4096 at 4096: Input/output error
/dev/sds: read failed after 0 of 4096 at 0: Input/output error
/dev/sds: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sds: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sds: read failed after 0 of 4096 at 4096: Input/output error
/dev/sday: read failed after 0 of 4096 at 0: Input/output error
/dev/sday: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sday: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sday: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdd: read failed after 0 of 4096 at 0: Input/output error
/dev/sdd: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdd: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdd: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdt: read failed after 0 of 4096 at 0: Input/output error
/dev/sdt: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdt: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdt: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaj: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaz: read failed after 0 of 4096 at 4096: Input/output error
/dev/sde: read failed after 0 of 4096 at 0: Input/output error
/dev/sde: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sde: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sde: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdu: read failed after 0 of 4096 at 0: Input/output error
/dev/sdu: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdu: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdu: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdf: read failed after 0 of 4096 at 0: Input/output error
/dev/sdf: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdf: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdf: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdv: read failed after 0 of 4096 at 0: Input/output error
/dev/sdv: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdv: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdv: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdg: read failed after 0 of 4096 at 0: Input/output error
/dev/sdg: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdg: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdg: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdx: read failed after 0 of 4096 at 0: Input/output error
/dev/sdx: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdx: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdx: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdan: read failed after 0 of 4096 at 0: Input/output error
/dev/sdan: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdan: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdan: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdy: read failed after 0 of 4096 at 0: Input/output error
/dev/sdy: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdy: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdy: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdz: read failed after 0 of 4096 at 0: Input/output error
/dev/sdz: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdz: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdz: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 0: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdaa: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdab: read failed after 0 of 4096 at 0: Input/output error
/dev/sdab: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdab: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdab: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdac: read failed after 0 of 4096 at 0: Input/output error
/dev/sdac: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdac: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdac: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdau: read failed after 0 of 4096 at 0: Input/output error
/dev/sdau: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdau: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdau: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdp: read failed after 0 of 4096 at 0: Input/output error
/dev/sdp: read failed after 0 of 4096 at 53687025664: Input/output error
/dev/sdp: read failed after 0 of 4096 at 53687083008: Input/output error
/dev/sdp: read failed after 0 of 4096 at 4096: Input/output error
/dev/sdav: read failed after 0 of 4096 at 0: Input/output error
/dev/sdav: read failed after 0 of 4096 at 1099511562240: Input/output error
/dev/sdav: read failed after 0 of 4096 at 1099511619584: Input/output error
/dev/sdav: read failed after 0 of 4096 at 4096: Input/output error
--- Physical volume ---
PV Name /dev/mapper/mpathap2
VG Name vg_XXXXXX
PV Size 49.51 GiB / not usable 3.00 MiB
Allocatable yes (but full)
PE Size 4.00 MiB
Total PE 12674
Free PE 0
Allocated PE 12674
-
jdalrymple
- Skynet Drone
- Posts: 2620
- Joined: Wed Feb 11, 2015 1:56 pm
Re: Disk I/O for all Multipath devices
This means you are not "making partitions" on those devices. The MPIO driver has them. In order to know anything (real and useful) about IO on those devices it will have to go through the MPIO driver.yunushaikh wrote:Output of PVDisplay :
pvdisplayCode: Select all
/dev/sda: read failed after 0 of 4096 at 0: Input/output error /dev/sda: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sda: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sda: read failed after 0 of 4096 at 4096: Input/output error /dev/sdq: read failed after 0 of 4096 at 0: Input/output error /dev/sdq: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdq: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdq: read failed after 0 of 4096 at 4096: Input/output error /dev/sdaw: read failed after 0 of 4096 at 0: Input/output error /dev/sdaw: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdaw: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdaw: read failed after 0 of 4096 at 4096: Input/output error /dev/sdb: read failed after 0 of 4096 at 0: Input/output error /dev/sdb: read failed after 0 of 4096 at 53687025664: Input/output error /dev/sdb: read failed after 0 of 4096 at 53687083008: Input/output error /dev/sdb: read failed after 0 of 4096 at 4096: Input/output error /dev/sdr: read failed after 0 of 4096 at 0: Input/output error /dev/sdr: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdr: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdr: read failed after 0 of 4096 at 4096: Input/output error /dev/sdax: read failed after 0 of 4096 at 0: Input/output error /dev/sdax: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdax: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdax: read failed after 0 of 4096 at 4096: Input/output error /dev/sdc: read failed after 0 of 4096 at 0: Input/output error /dev/sdc: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdc: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdc: read failed after 0 of 4096 at 4096: Input/output error /dev/sds: read failed after 0 of 4096 at 0: Input/output error /dev/sds: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sds: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sds: read failed after 0 of 4096 at 4096: Input/output error /dev/sday: read failed after 0 of 4096 at 0: Input/output error /dev/sday: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sday: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sday: read failed after 0 of 4096 at 4096: Input/output error /dev/sdd: read failed after 0 of 4096 at 0: Input/output error /dev/sdd: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdd: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdd: read failed after 0 of 4096 at 4096: Input/output error /dev/sdt: read failed after 0 of 4096 at 0: Input/output error /dev/sdt: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdt: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdt: read failed after 0 of 4096 at 4096: Input/output error /dev/sdaj: read failed after 0 of 4096 at 0: Input/output error /dev/sdaj: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdaj: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdaj: read failed after 0 of 4096 at 4096: Input/output error /dev/sdaz: read failed after 0 of 4096 at 0: Input/output error /dev/sdaz: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdaz: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdaz: read failed after 0 of 4096 at 4096: Input/output error /dev/sde: read failed after 0 of 4096 at 0: Input/output error /dev/sde: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sde: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sde: read failed after 0 of 4096 at 4096: Input/output error /dev/sdu: read failed after 0 of 4096 at 0: Input/output error /dev/sdu: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdu: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdu: read failed after 0 of 4096 at 4096: Input/output error /dev/sdf: read failed after 0 of 4096 at 0: Input/output error /dev/sdf: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdf: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdf: read failed after 0 of 4096 at 4096: Input/output error /dev/sdv: read failed after 0 of 4096 at 0: Input/output error /dev/sdv: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdv: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdv: read failed after 0 of 4096 at 4096: Input/output error /dev/sdg: read failed after 0 of 4096 at 0: Input/output error /dev/sdg: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdg: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdg: read failed after 0 of 4096 at 4096: Input/output error /dev/sdx: read failed after 0 of 4096 at 0: Input/output error /dev/sdx: read failed after 0 of 4096 at 53687025664: Input/output error /dev/sdx: read failed after 0 of 4096 at 53687083008: Input/output error /dev/sdx: read failed after 0 of 4096 at 4096: Input/output error /dev/sdan: read failed after 0 of 4096 at 0: Input/output error /dev/sdan: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdan: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdan: read failed after 0 of 4096 at 4096: Input/output error /dev/sdy: read failed after 0 of 4096 at 0: Input/output error /dev/sdy: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdy: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdy: read failed after 0 of 4096 at 4096: Input/output error /dev/sdz: read failed after 0 of 4096 at 0: Input/output error /dev/sdz: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdz: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdz: read failed after 0 of 4096 at 4096: Input/output error /dev/sdaa: read failed after 0 of 4096 at 0: Input/output error /dev/sdaa: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdaa: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdaa: read failed after 0 of 4096 at 4096: Input/output error /dev/sdab: read failed after 0 of 4096 at 0: Input/output error /dev/sdab: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdab: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdab: read failed after 0 of 4096 at 4096: Input/output error /dev/sdac: read failed after 0 of 4096 at 0: Input/output error /dev/sdac: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdac: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdac: read failed after 0 of 4096 at 4096: Input/output error /dev/sdau: read failed after 0 of 4096 at 0: Input/output error /dev/sdau: read failed after 0 of 4096 at 53687025664: Input/output error /dev/sdau: read failed after 0 of 4096 at 53687083008: Input/output error /dev/sdau: read failed after 0 of 4096 at 4096: Input/output error /dev/sdp: read failed after 0 of 4096 at 0: Input/output error /dev/sdp: read failed after 0 of 4096 at 53687025664: Input/output error /dev/sdp: read failed after 0 of 4096 at 53687083008: Input/output error /dev/sdp: read failed after 0 of 4096 at 4096: Input/output error /dev/sdav: read failed after 0 of 4096 at 0: Input/output error /dev/sdav: read failed after 0 of 4096 at 1099511562240: Input/output error /dev/sdav: read failed after 0 of 4096 at 1099511619584: Input/output error /dev/sdav: read failed after 0 of 4096 at 4096: Input/output error