check_snmp_storage doesn't check all FS

Support forum for Nagios Core, Nagios Plugins, NCPA, NRPE, NSCA, NDOUtils and more. Engage with the community of users including those using the open source solutions.
emi65
Posts: 119
Joined: Fri Aug 17, 2012 3:41 am

check_snmp_storage doesn't check all FS

Post by emi65 »

Hi

I'm using nagios core 4.2.1 and check_snmp_storage
Version : 1.3.3
# Date : Jun 1 2007

On the Linux machine I got this info
[root@sgsvrasjdcs51lx:/]# df -kh
Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/vg00-lv_slash ext4 5.0G 3.0G 1.7G 65% /
tmpfs tmpfs 3.9G 0 3.9G 0% /dev/shm
/dev/sda1 ext4 477M 67M 385M 15% /boot
/dev/mapper/vg00-lv_home ext4 976M 902M 24M 98% /home
/dev/mapper/vg00-lv_tmp ext4 976M 1.4M 924M 1% /tmp
/dev/mapper/vg00-lv_var ext4 5.0G 557M 4.2G 12% /var
/dev/mapper/vg00-lv_backup ext4 2.0G 1.8G 47M 98% /var/backup


I do this check
check_snmp_storage -H X.x.x.x -S0,1 -C public -m / -q "FixedDisk|NetworkDisk/other" -w95 -c98 -o 20000 -t 60
OK : (<95%) All selected storages

Why the check didn't show the CRITICAL for /var/backup and /home ?

Thanks for the help
Emilio
User avatar
rhassing
Posts: 412
Joined: Sat Oct 05, 2013 10:29 pm
Location: Netherlands

Re: check_snmp_storage doesn't check all FS

Post by rhassing »

I do this check
check_snmp_storage -H X.x.x.x -S0,1 -C public -m / -q "FixedDisk|NetworkDisk/other" -w95 -c98 -o 20000 -t 60
OK : (<95%) All selected storages
The -m / tells the script to only check /.

Please try the folowiing:

Code: Select all

check_snmp_storage -H X.x.x.x -S0,1 -C public -m ^/ -q "FixedDisk|NetworkDisk/other" -w95 -c98 -o 20000 -t 60
The only character I changed was the ^ before the /
Rob Hassing
Image
emi65
Posts: 119
Joined: Fri Aug 17, 2012 3:41 am

Re: check_snmp_storage doesn't check all FS

Post by emi65 »

Nothing is change

I attemped to decrease the WARN and CRITICAL Limit
check_snmp_storage -H 10.211.30.89 -S0,1 -C SGS-MGMT-01 -m ^/ -q "FixedDisk|NetworkDisk" -w5 -c8 -o 20000 -t 60
CRITICAL : (>8%) /var/backup: 95%used(1848MB/1952MB) /var: 11%used(557MB/5102MB) /boot: 14%used(67MB/476MB) /home: 92%used(901MB/976MB) /: 61%used(3060MB/5038MB)

[nagios@sgsvrasjdcs51lx:~]$ df -k
Filesystem Type 1024-blocks Used Available Capacity Mounted on
/dev/mapper/vg00-lv_slash ext4 5158520 3133140 1756700 65% /
tmpfs tmpfs 4026680 0 4026680 0% /dev/shm
/dev/sda1 ext4 487652 68273 393779 15% /boot
/dev/mapper/vg00-lv_home ext4 999320 923108 23784 98% /home
/dev/mapper/vg00-lv_tmp ext4 999320 1380 945512 1% /tmp
/dev/mapper/vg00-lv_var ext4 5224056 569924 4385476 12% /var
/dev/mapper/vg00-lv_backup ext4 1998672 1892356 1472 100% /var/backup

So you can see that "df -k" comand show /var/backup 100% used
the check show /var/backup: 95%used(1848MB/1952MB)

seems that df -k usign a different way to calculate the used space from the check

Why this difference ?
User avatar
mcapra
Posts: 3739
Joined: Thu May 05, 2016 3:54 pm

Re: check_snmp_storage doesn't check all FS

Post by mcapra »

Can you share the full output of this command executed from the CLI of your Nagios Core machine:

Code: Select all

snmpwalk -mALL -v2c -cSGS-MGMT-01 10.211.30.89 1.3.6.1.2.1.25.2.3
My guess is that net-snmp isn't correctly reporting disk sizes. There are a few Red Hat errata out there that describe similar such problems relating to block size, though I don't recall them off-hand.
Former Nagios employee
https://www.mcapra.com/
emi65
Posts: 119
Joined: Fri Aug 17, 2012 3:41 am

Re: check_snmp_storage doesn't check all FS

Post by emi65 »

here the requested info

HOST-RESOURCES-MIB::hrStorageIndex.31 = INTEGER: 31
HOST-RESOURCES-MIB::hrStorageIndex.35 = INTEGER: 35
HOST-RESOURCES-MIB::hrStorageIndex.36 = INTEGER: 36
HOST-RESOURCES-MIB::hrStorageIndex.37 = INTEGER: 37
HOST-RESOURCES-MIB::hrStorageIndex.38 = INTEGER: 38
HOST-RESOURCES-MIB::hrStorageIndex.39 = INTEGER: 39
HOST-RESOURCES-MIB::hrStorageIndex.40 = INTEGER: 40
HOST-RESOURCES-MIB::hrStorageType.1 = OID: HOST-RESOURCES-TYPES::hrStorageRam
HOST-RESOURCES-MIB::hrStorageType.3 = OID: HOST-RESOURCES-TYPES::hrStorageVirtualMemory
HOST-RESOURCES-MIB::hrStorageType.6 = OID: HOST-RESOURCES-TYPES::hrStorageOther
HOST-RESOURCES-MIB::hrStorageType.7 = OID: HOST-RESOURCES-TYPES::hrStorageOther
HOST-RESOURCES-MIB::hrStorageType.10 = OID: HOST-RESOURCES-TYPES::hrStorageVirtualMemory
HOST-RESOURCES-MIB::hrStorageType.31 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageType.35 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageType.36 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageType.37 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageType.38 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageType.39 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageType.40 = OID: HOST-RESOURCES-TYPES::hrStorageFixedDisk
HOST-RESOURCES-MIB::hrStorageDescr.1 = STRING: Physical memory
HOST-RESOURCES-MIB::hrStorageDescr.3 = STRING: Virtual memory
HOST-RESOURCES-MIB::hrStorageDescr.6 = STRING: Memory buffers
HOST-RESOURCES-MIB::hrStorageDescr.7 = STRING: Cached memory
HOST-RESOURCES-MIB::hrStorageDescr.10 = STRING: Swap space
HOST-RESOURCES-MIB::hrStorageDescr.31 = STRING: /
HOST-RESOURCES-MIB::hrStorageDescr.35 = STRING: /dev/shm
HOST-RESOURCES-MIB::hrStorageDescr.36 = STRING: /boot
HOST-RESOURCES-MIB::hrStorageDescr.37 = STRING: /home
HOST-RESOURCES-MIB::hrStorageDescr.38 = STRING: /tmp
HOST-RESOURCES-MIB::hrStorageDescr.39 = STRING: /var
HOST-RESOURCES-MIB::hrStorageDescr.40 = STRING: /var/backup
HOST-RESOURCES-MIB::hrStorageAllocationUnits.1 = INTEGER: 1024 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.3 = INTEGER: 1024 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.6 = INTEGER: 1024 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.7 = INTEGER: 1024 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.10 = INTEGER: 1024 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.31 = INTEGER: 4096 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.35 = INTEGER: 4096 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.36 = INTEGER: 1024 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.37 = INTEGER: 4096 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.38 = INTEGER: 4096 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.39 = INTEGER: 4096 Bytes
HOST-RESOURCES-MIB::hrStorageAllocationUnits.40 = INTEGER: 4096 Bytes
User avatar
mcapra
Posts: 3739
Joined: Thu May 05, 2016 3:54 pm

Re: check_snmp_storage doesn't check all FS

Post by mcapra »

Hmm, the snmpwalk output is missing some important fields. Most importantly, hrStorageUsed and hrStorageSize. What's the output of these:

Code: Select all

snmpwalk -mALL -v2c -cSGS-MGMT-01 10.211.30.89 1.3.6.1.2.1.25.2.3.1.5
snmpwalk -mALL -v2c -cSGS-MGMT-01 10.211.30.89 1.3.6.1.2.1.25.2.3.1.6
Former Nagios employee
https://www.mcapra.com/
emi65
Posts: 119
Joined: Fri Aug 17, 2012 3:41 am

Re: check_snmp_storage doesn't check all FS

Post by emi65 »

here

snmpwalk -mALL -v2c -cSGS-MGMT-01 10.211.30.89 1.3.6.1.2.1.25.2.3.1.5
HOST-RESOURCES-MIB::hrStorageSize.1 = INTEGER: 8053360
HOST-RESOURCES-MIB::hrStorageSize.3 = INTEGER: 9101932
HOST-RESOURCES-MIB::hrStorageSize.6 = INTEGER: 8053360
HOST-RESOURCES-MIB::hrStorageSize.7 = INTEGER: 757976
HOST-RESOURCES-MIB::hrStorageSize.10 = INTEGER: 1048572
HOST-RESOURCES-MIB::hrStorageSize.31 = INTEGER: 1289630
HOST-RESOURCES-MIB::hrStorageSize.35 = INTEGER: 1006670
HOST-RESOURCES-MIB::hrStorageSize.36 = INTEGER: 487652
HOST-RESOURCES-MIB::hrStorageSize.37 = INTEGER: 249830
HOST-RESOURCES-MIB::hrStorageSize.38 = INTEGER: 249830
HOST-RESOURCES-MIB::hrStorageSize.39 = INTEGER: 1306014
HOST-RESOURCES-MIB::hrStorageSize.40 = INTEGER: 499668


snmpwalk -mALL -v2c -cSGS-MGMT-01 10.211.30.89 1.3.6.1.2.1.25.2.3.1.6
HOST-RESOURCES-MIB::hrStorageUsed.1 = INTEGER: 1748880
HOST-RESOURCES-MIB::hrStorageUsed.3 = INTEGER: 1748880
HOST-RESOURCES-MIB::hrStorageUsed.6 = INTEGER: 294700
HOST-RESOURCES-MIB::hrStorageUsed.7 = INTEGER: 757976
HOST-RESOURCES-MIB::hrStorageUsed.10 = INTEGER: 0
HOST-RESOURCES-MIB::hrStorageUsed.31 = INTEGER: 783285
HOST-RESOURCES-MIB::hrStorageUsed.35 = INTEGER: 0
HOST-RESOURCES-MIB::hrStorageUsed.36 = INTEGER: 68273
HOST-RESOURCES-MIB::hrStorageUsed.37 = INTEGER: 376
HOST-RESOURCES-MIB::hrStorageUsed.38 = INTEGER: 345
HOST-RESOURCES-MIB::hrStorageUsed.39 = INTEGER: 235806
HOST-RESOURCES-MIB::hrStorageUsed.40 = INTEGER: 768


thank a lot for your time !!!
User avatar
tgriep
Madmin
Posts: 9177
Joined: Thu Oct 30, 2014 9:02 am

Re: check_snmp_storage doesn't check all FS

Post by tgriep »

Your command

Code: Select all

check_snmp_storage -H 10.211.30.89 -S0,1 -C SGS-MGMT-01 -m ^/ -q "FixedDisk|NetworkDisk" -w5 -c8 -o 20000 -t 60
Seems to be working, as the output,

Code: Select all

CRITICAL : (>8%) /var/backup: 95%used(1848MB/1952MB) /var: 11%used(557MB/5102MB) /boot: 14%used(67MB/476MB) /home: 92%used(901MB/976MB) /: 61%used(3060MB/5038MB)
is generating a critical state because the drives used space is over 8% which is correct.
Be sure to check out our Knowledgebase for helpful articles and solutions!
emi65
Posts: 119
Joined: Fri Aug 17, 2012 3:41 am

Re: check_snmp_storage doesn't check all FS

Post by emi65 »

The problem is not the critical state in my example but the difference from df -k output e the check_snmp_storage

[nagios@sgsvrasjdcs51lx:~]$ df -k
Filesystem Type 1024-blocks Used Available Capacity Mounted on
/dev/mapper/vg00-lv_slash ext4 5158520 3133140 1756700 65% /
tmpfs tmpfs 4026680 0 4026680 0% /dev/shm
/dev/sda1 ext4 487652 68273 393779 15% /boot
/dev/mapper/vg00-lv_home ext4 999320 923108 23784 98% /home
/dev/mapper/vg00-lv_tmp ext4 999320 1380 945512 1% /tmp
/dev/mapper/vg00-lv_var ext4 5224056 569924 4385476 12% /var
/dev/mapper/vg00-lv_backup ext4 1998672 1892356 1472 100% /var/backup

So you can see that "df -k" comand show /var/backup 100% used
the check_snmp_storage shows
CRITICAL : (>8%) /var/backup: 95%used(1848MB/1952MB) /var: 11%used(557MB/5102MB) /boot: 14%used(67MB/476MB) /home: 92%used(901MB/976MB) /: 61%used(3060MB/5038MB)

seems that df -k uses a different way to calculate the used space then the check_snmp_storage

So the unix administrator asks me why the var/backup is full and the nagios check show me /var/backup is 95% used

I hope to explained better the question/problem

Thanks
Emilio
User avatar
mcapra
Posts: 3739
Joined: Thu May 05, 2016 3:54 pm

Re: check_snmp_storage doesn't check all FS

Post by mcapra »

I think it's a discrepancy in the block sizes. df -k seems to be using 1024 byte blocks where as net-snmp is reporting the block size for /var/backup as 4096 bytes. As shown here:

Code: Select all

HOST-RESOURCES-MIB::hrStorageDescr.40 = STRING: /var/backup
HOST-RESOURCES-MIB::hrStorageAllocationUnits.40 = INTEGER: 4096 Bytes
Former Nagios employee
https://www.mcapra.com/
Locked