checksnmp plugin timed out

[udaykumar]

Hi Team,

We are facing some issue with checksnmp, While we use "run check command" we are getting the below error.

nagios@localhost ~]$ /usr/local/nagios/libexec/check_snmp -H X X X X -o ISILON-MIB::tempSensorValue.2 -l "CPU1 Temperature"
CRITICAL - Plugin timed out while executing system call

Could you please us what we have to check from server end and client end.

[lmiltchev]

You can start troubleshooting by trying the following:

1. Double check the community string. Do you have an typo? Any special characters, that could be causing the issue?

2. Re-run your check with increased verbosity (by adding the "-v" flag at the end of your check). Hopefully, this will give us some clues.

3. Try increasing the timeout by adding "-t 60" to your check. Did this help?

4. Check to see if your firewall is blocking UDP port 161.

5. Can you run snmpwalk successfully against your server/device?

[udaykumar]

1) We have checked community string working fine, we checked with snmpwalk command giving output also as below


[root@NAG01 ~]# snmpwalk -v 2c -H XXXX -c xxxx

IF-MIB::ifConnectorPresent.5 = INTEGER: false(2)
IF-MIB::ifConnectorPresent.6 = INTEGER: true(1)
IF-MIB::ifConnectorPresent.7 = INTEGER: true(1)
IF-MIB::ifAlias.1 = STRING:
IF-MIB::ifAlias.2 = STRING:
IF-MIB::ifAlias.3 = STRING:
IF-MIB::ifAlias.4 = STRING:
IF-MIB::ifAlias.5 = STRING:
IF-MIB::ifAlias.6 = STRING:
IF-MIB::ifAlias.7 = STRING:
IF-MIB::ifCounterDiscontinuityTime.1 = Timeticks: (0) 0:00:00.00
IF-MIB::ifCounterDiscontinuityTime.2 = Timeticks: (0) 0:00:00.00
IF-MIB::ifCounterDiscontinuityTime.3 = Timeticks: (0) 0:00:00.00
IF-MIB::ifCounterDiscontinuityTime.4 = Timeticks: (0) 0:00:00.00
IF-MIB::ifCounterDiscontinuityTime.5 = Timeticks: (0) 0:00:00.00
IF-MIB::ifCounterDiscontinuityTime.6 = Timeticks: (0) 0:00:00.00
IF-MIB::ifCounterDiscontinuityTime.7 = Timeticks: (0) 0:00:00.00
IF-MIB::ifStackStatus.0.1 = INTEGER: active(1)
IF-MIB::ifStackStatus.0.2 = INTEGER: active(1)
IF-MIB::ifStackStatus.0.3 = INTEGER: active(1)
IF-MIB::ifStackStatus.0.4 = INTEGER: active(1)
IF-MIB::ifStackStatus.0.5 = INTEGER: active(1)
IF-MIB::ifStackStatus.0.6 = INTEGER: active(1)
IF-MIB::ifStackStatus.0.7 = INTEGER: active(1)
IF-MIB::ifStackStatus.1.0 = INTEGER: active(1)
IF-MIB::ifStackStatus.2.0 = INTEGER: active(1)

2) We tried by using -v


[root@NAG01 ~]# /usr/local/nagios/libexec/check_snmp -H XXXX -C xxx -o ISILON-MIB::fanSpeed.1 -l "Chassis Fan 1 RPMs" -v
/usr/bin/snmpget -Le -t 10 -r 5 -m ALL -v 1 [context] [authpriv] XXXX:161 ISILON-MIB::fanSpeed.1
CRITICAL - Plugin timed out while executing system call

3) we tried telnet udp port working fine
[root@NAG01 ~]# nc -vz -u XXXX 161
Connection to XXXXX 161 port [udp/snmp] succeeded!

4) tried with -t 60
[root@NAG01 ~]# /usr/local/nagios/libexec/check_snmp -H XXXX -t 60 -C xxx -o ISILON-MIB::fanSpeed.1 -l "Chassis Fan 1 RPMs"
CRITICAL - Plugin timed out while executing system call


Could you please us with what would be the reason.

[lmiltchev]

It is possible that SNMP v1 is disabled on this device. Can you run snmpwalk with v 1 successfully against it?

Code: Select all

snmpwalk -v 1 -c <community> <ip address>

How about this command?

Code: Select all

/usr/local/nagios/libexec/check_snmp -H XXXX -t 60 -C xxx -P 2c -o ISILON-MIB::fanSpeed.1 -l "Chassis Fan 1 RPMs"

[udaykumar]

Hi Team,

thanks for the reply,
We are able to get reply from snmp device but in console it is showing critical. Can you help what would be reason to display and how to resolve this.
[root@NAG01 ~]# /usr/local/nagios/libexec/check_snmp -H XXXXX -C lonpublic -P 2c -o ISILON-MIB::diskStatus.1,diskStatus.2,diskStatus.3,diskStatus.4,diskStatus.5,diskStatus.6,diskStatus.7,diskStatus.8,diskStatus.9,diskStatus.10,diskStatus.11,diskStatus.12,diskStatus.13,diskStatus.14,diskStatus.15,diskStatus.16,diskStatus.17,diskStatus.18,diskStatus.19,diskStatus.20,diskStatus.21,diskStatus.22,diskStatus.23,diskStatus.24 -l "Disk 1:","Disk 2:","Disk 3:","Disk 4:","Disk 5:","Disk 6:","Disk 7:","Disk 8:","Disk 9:","Disk 10:","Disk 11:","Disk 12:","Disk 13:","Disk 14:","Disk 15:","Disk 16:","Disk 17:","Disk 18:","Disk 19:","Disk 20:","Disk 21:","Disk 22:","Disk 23:","Disk 24:" -s "HEALTHY"

SNMP OK - Disk 1: HEALTHY Disk 2: HEALTHY Disk 3: HEALTHY Disk 4: HEALTHY Disk 5: HEALTHY Disk 6: HEALTHY Disk 7: HEALTHY Disk 8: HEALTHY Disk 9: HEALTHY Disk 10: HEALTHY Disk 11: HEALTHY Disk 12: HEALTHY Disk 13: HEALTHY Disk 14: HEALTHY Disk 15: HEALTHY Disk 16: HEALTHY Disk 17: HEALTHY Disk 18: HEALTHY Disk 19: HEALTHY Disk 20: HEALTHY Disk 21: HEALTHY Disk 22: HEALTHY Disk 23: HEALTHY Disk 24: HEALTHY |

For the first command we are getting like below


[root@NAG01 ~]# snmpwalk -v 1 -c lonpublic -H XXXXX
Configuration directives understood:
No log handling enabled - turning on stderr logging
In snmpwalk.conf and snmpwalk.local.conf:
includeRequested (1|yes|true|0|no|false)
excludeRequested (1|yes|true|0|no|false)
printStatistics (1|yes|true|0|no|false)
dontCheckOrdering (1|yes|true|0|no|false)
timeResults (1|yes|true|0|no|false)
In snmp.conf and snmp.local.conf:
alias NAME TRANSPORT_DEFINITION
doDebugging (1|0)
debugTokens token[,token...]
logTimestamp (1|yes|true|0|no|false)
mibdirs [mib-dirs|+mib-dirs|-mib-dirs]
mibs [mib-tokens|+mib-tokens]
mibfile mibfile-to-read
showMibErrors (1|yes|true|0|no|false)
commentToEOL (1|yes|true|0|no|false)
strictCommentTerm (1|yes|true|0|no|false)
mibAllowUnderline (1|yes|true|0|no|false)
mibWarningLevel integerValue
mibReplaceWithLatest (1|yes|true|0|no|false)
printNumericEnums (1|yes|true|0|no|false)
printNumericOids (1|yes|true|0|no|false)
escapeQuotes (1|yes|true|0|no|false)
dontBreakdownOids (1|yes|true|0|no|false)
quickPrinting (1|yes|true|0|no|false)
numericTimeticks (1|yes|true|0|no|false)
oidOutputFormat integerValue
suffixPrinting integerValue
extendedIndex (1|yes|true|0|no|false)
printHexText (1|yes|true|0|no|false)
printValueOnly (1|yes|true|0|no|false)
dontPrintUnits (1|yes|true|0|no|false)
hexOutputLength integerValue
dumpPacket (1|yes|true|0|no|false)
reverseEncodeBER (1|yes|true|0|no|false)
defaultPort integerValue
defCommunity string
noTokenWarnings (1|yes|true|0|no|false)
noRangeCheck (1|yes|true|0|no|false)
persistentDir string
tempFilePattern string
noDisplayHint (1|yes|true|0|no|false)
16bitIDs (1|yes|true|0|no|fals

What does it meaning above output could you explain please.

I have tried with V 2 also

[root@NAG01 ~]# snmpwalk -v 2 -c lonpublic -H XXXXX
Invalid version specified after -v flag: 2
USAGE: snmpwalk [OPTIONS] AGENT [OID]

Version: 5.5
Web: http://www.net-snmp.org/
Email: [email protected]

OPTIONS:
-h, --help display this help message
-H display configuration file directives understood
-v 1|2c|3 specifies SNMP version to use
-V, --version display package version number
SNMP Version 1 or 2c specific
-c COMMUNITY set the community string
SNMP Version 3 specific
-a PROTOCOL set authentication protocol (MD5|SHA)
-A PASSPHRASE set authentication protocol pass phrase
-e ENGINE-ID set security engine ID (e.g. 800000020109840301)
-E ENGINE-ID set context engine ID (e.g. 800000020109840301)
-l LEVEL set security level (noAuthNoPriv|authNoPriv|authPriv)
-n CONTEXT set context name (e.g. bridge1)
-u USER-NAME set security name (e.g. bert)
-x PROTOCOL set privacy protocol (DES|AES)
-X PASSPHRASE set privacy protocol pass phrase
-Z BOOTS,TIME set destination engine boots/time
General communication options
-r RETRIES set the number of retries
-t TIMEOUT set the request timeout (in seconds)
Debugging
-d dump input/output packets in hexadecimal
-D TOKEN[,...] turn on debugging output for the specified TOKENs
(ALL gives extremely verbose debugging output)
General options
-m MIB[:...] load given list of MIBs (ALL loads everything)
-M DIR[:...] look in given list of directories for MIBs
-P MIBOPTS Toggle various defaults controlling MIB parsing:
u: allow the use of underlines in MIB symbols
c: disallow the use of "--" to terminate comments
d: save the DESCRIPTIONs of the MIB objects
e: disable errors when MIB symbols conflict
w: enable warnings when MIB symbols conflict
W: enable detailed warnings when MIB symbols conflict
R: replace MIB symbols from latest module
-O OUTOPTS Toggle various defaults controlling output display:
0: print leading 0 for single-digit hex characters
a: print all strings in ascii format
b: do not break OID indexes down
e: print enums numerically
E: escape quotes in string indices
f: print full OIDs on output
n: print OIDs numerically
q: quick print for easier parsing
Q: quick print with equal-signs
s: print only last symbolic element of OID
S: print MIB module-id plus last element
t: print timeticks unparsed as numeric integers
T: print human-readable text along with hex strings
u: print OIDs using UCD-style prefix suppression
U: don't print units
v: print values only (not OID = value)
x: print all strings in hex format
X: extended index format
-I INOPTS Toggle various defaults controlling input parsing:
b: do best/regex matching to find a MIB node
h: don't apply DISPLAY-HINTs
r: do not check values for range/type legality
R: do random access to OID

What i understand after executing V 2 , device will working with V 2 version. Correct me if i am wrong.

[lmiltchev]

[root@NAG01 ~]# snmpwalk -v 1 -c lonpublic -H XXXXX
...
What does it meaning above output could you explain please.

The plugin shows you the usage (help menu) as your command was wrong. I asked you to run:

Code: Select all

snmpwalk -v 1 -c <community> <ip address>

but you ran:

Code: Select all

snmpwalk -v 1 -c <community> -H <ip address>

"-H" doesn't belong in this command, that's why the plugin "complains".

Note: I wanted you to run snmpwalk with SNMP v 1, so that I could see if the command will time out. I suspect that SNMP v1 is not enabled on this device.

[root@NAG01 ~]# snmpwalk -v 2 -c lonpublic -H XXXXX
Invalid version specified after -v flag: 2

It's the same error as above. You shouldn't be using "-H" in front of the IP address. Also, the protocol is "2c", not "2". Try:

Code: Select all

snmpwalk -v 2c -c lonpublic XXXXX

What i understand after executing V 2 , device will working with V 2 version. Correct me if i am wrong.

Yes, it seems like SNMP v 2c is working just fine. You will need to modify your check under the CCM, and add the "-P 2c" option. As far as the wrong status in the GUI goes, try removing the string match "HEALTHY". According to the plugin's usage, you would have an OK state only if the string is an exact match.

-s, --string=STRING
Return OK state (for that OID) if STRING is an exact match

If any of the disks returns anything else than "HEALTHY", your check will fail.

[udaykumar]

Hi Team,

Thanks for the replay,
Yes we have changed configuration with -P2c -C password. It's working fine
Without -C Password is not working before its worked. But now its not working without -C Password.

The below are the changing in CCM. We have removed -s "HEALTHY". Now its showing OK in Nagios console.
If any disk will have problem does it throws the alert because we removed -s "HEALTHY"?


[[email protected] ~]$ /usr/local/nagios/libexec/check_snmp -H XXXX-P 2c -C lonpublic -o ISILON-MIB::diskStatus.1,diskStatus.2,diskStatus.3,diskStatus.4,diskStatus.5,diskStatus.6,diskStatus.7,diskStatus.8,diskStatus.9,diskStatus.10,diskStatus.11,diskStatus.12,diskStatus.13,diskStatus.14,diskStatus.15,diskStatus.16,diskStatus.17,diskStatus.18,diskStatus.19,diskStatus.20,diskStatus.21,diskStatus.22,diskStatus.23,diskStatus.24 -l "Disk 1:","Disk 2:","Disk 3:","Disk 4:","Disk 5:","Disk 6:","Disk 7:","Disk 8:","Disk 9:","Disk 10:","Disk 11:","Disk 12:","Disk 13:","Disk 14:","Disk 15:","Disk 16:","Disk 17:","Disk 18:","Disk 19:","Disk 20:","Disk 21:","Disk 22:","Disk 23:","Disk 24:"


SNMP OK - Disk 1: HEALTHY Disk 2: HEALTHY Disk 3: HEALTHY Disk 4: HEALTHY Disk 5: HEALTHY Disk 6: HEALTHY Disk 7: HEALTHY Disk 8: HEALTHY Disk 9: HEALTHY Disk 10: HEALTHY Disk 11: HEALTHY Disk 12: HEALTHY Disk 13: HEALTHY Disk 14: HEALTHY Disk 15: HEALTHY Disk 16: HEALTHY Disk 17: HEALTHY Disk 18: HEALTHY Disk 19: HEALTHY Disk 20: HEALTHY Disk 21: HEALTHY Disk 22: HEALTHY Disk 23: HEALTHY Disk 24: HEALTHY |


I have defined the below command to check the CPU1 Temperature its working fine but I have not define the warning and critical then how it will through the alert.



[[email protected] ~]$ /usr/local/nagios/libexec/check_snmp -H xxxx -P 2c -C lonpublic -o ISILON-MIB::tempSensorValue.2 -l "CPU1 Temperature" SNMP OK - CPU1 Temperature 59.500000 | 'CPU1 Temperature'=59.500000

If i want to define Warning & Critical Can u please suggest how to define and Warning & Critical

[lmiltchev]

Without -C Password is not working before its worked. But now its not working without -C Password.

I am not sure why it was working before without passing the community string... If you used the "default" one ("public"), you wouldn't need to specify it explicitly. Also, the community string wouldn't be needed if you used SNMP v3. It's hard to say what was the case.

If any disk will have problem does it throws the alert because we removed -s "HEALTHY"?

I believe so, but I haven't tested it to be 100% sure. If you wanted to search for a pattern, instead of using the "-s" flag (exact match), you could try using the "-r" flag (regex match).

-r, --ereg=REGEX
Return OK state (for that OID) if extended regular expression REGEX matches

You would need to try it in your environment to see if this is going to do the job for you.

I have defined the below command to check the CPU1 Temperature its working fine but I have not define the warning and critical then how it will through the alert.
...
If i want to define Warning & Critical Can u please suggest how to define and Warning & Critical

As with most plugins, you would need to use the "-w" and "-c" options.

-w, --warning=THRESHOLD(s)
Warning threshold range(s)
-c, --critical=THRESHOLD(s)
Critical threshold range(s)

Try something like this:

Code: Select all

/usr/local/nagios/libexec/check_snmp -H xxxx -P 2c -C lonpublic -o ISILON-MIB::tempSensorValue.2 -l "CPU1 Temperature" -w 50 -c 100

or whatever values you would like to use.