Costantly getting Uknown Errors monitoing ESX

[bosecorp]

[1435646052] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - HOST MEM Unknown error
[1435646107] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;OK;SOFT;2;ESX3 OK - mem usage=597600.48 MB (56.99%), overhead=5722.32 MB, swapped=5.60 MB
[1435646292] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435646307] SERVICE ALERT: myESXSERVERvm02.bose.com;Memory for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - HOST MEM Unknown error
[1435646327] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435646347] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;2;ESX3 CRITICAL - all 8 NICs are connected
[1435646368] SERVICE ALERT: myESXSERVERvm02.bose.com;Memory for VMHost;OK;SOFT;2;ESX3 OK - mem usage=512877.93 MB (48.91%), overhead=5384.54 MB, swapped=0.00 MB
[1435646381] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;2;ESX3 CRITICAL - all 8 NICs are connected
[1435646408] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;OK;SOFT;3;ESX3 OK - net receive=1988.00 KB/s, send=2512.00 KB/s, all 8 NICs are connected
[1435646442] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;3;ESX3 CRITICAL - all 8 NICs are connected
[1435646501] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;OK;SOFT;4;ESX3 OK - net receive=8789.00 KB/s, send=557.00 KB/s, all 8 NICs are connected
[1435646668] SERVICE ALERT: myESXSERVERvm02.bose.com;Memory for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - HOST MEM Unknown error
[1435646701] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435646728] SERVICE ALERT: myESXSERVERvm02.bose.com;Memory for VMHost;OK;SOFT;2;ESX3 OK - mem usage=512876.78 MB (48.91%), overhead=5384.46 MB, swapped=0.00 MB
[1435646768] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=1808.00 KB/s, send=3841.00 KB/s, all 8 NICs are connected
[1435646802] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435646818] SERVICE ALERT: myESXSERVERavm01.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435646861] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=2380.00 KB/s, send=642.00 KB/s, all 8 NICs are connected
[1435646878] SERVICE ALERT: myESXSERVERavm01.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=0.00 KB/s, send=0.00 KB/s, all 8 NICs are connected
[1435647007] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - HOST MEM Unknown error
[1435647068] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;OK;SOFT;2;ESX3 OK - mem usage=597575.98 MB (56.99%), overhead=5722.32 MB, swapped=5.60 MB
[1435647161] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435647228] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=2490.00 KB/s, send=534.00 KB/s, all 8 NICs are connected
[1435647348] SERVICE ALERT: myESXSERVERvm03.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435647368] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435647401] SERVICE ALERT: myESXSERVERvm03.bose.com;Networking for VMHost;CRITICAL;SOFT;2;ESX3 CRITICAL - all 8 NICs are connected
[1435647427] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;2;ESX3 CRITICAL - all 8 NICs are connected
[1435647467] SERVICE ALERT: myESXSERVERvm03.bose.com;Networking for VMHost;OK;SOFT;3;ESX3 OK - net receive=71.00 KB/s, send=71.00 KB/s, all 8 NICs are connected
[1435647487] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;3;ESX3 CRITICAL - all 8 NICs are connected
[1435647528] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435647547] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;OK;SOFT;4;ESX3 OK - net receive=661.00 KB/s, send=4782.00 KB/s, all 8 NICs are connected
[1435647581] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=2172.00 KB/s, send=641.00 KB/s, all 8 NICs are connected
[1435647738] SERVICE ALERT: myESXSERVERavm05.bose.com;Datastore usage for VMHost;OK;HARD;1;ESX3 OK - storages : datastore1=133173.00 MB (99.28%), dce-Sys_4=381074.00 MB (18.17%), dce-Sys_3=386266.00 MB (18.42%), dce-Sys_5=374194.00 MB (17.85%), dce-App_2=228109.00 MB (10.88%), dce-App_7=51190.00 MB (2.44%), dce-App_9=5991.00 MB (0.29%), repl-dce-app1=555944.00 MB (53.03%), repl-dce-app2=634558.00 MB (60.53%), repl-dce-sys1=207578.00 MB (40.56%), dce-App_12=225141.00 MB (10.74%), dce-Sys_6=269164.00 MB (12.84%), dce-Sys_7=217246.00 MB (10.36%), dce-App_13=304584.00 MB (14.53%), repl-dce-app3=805331.00 MB (76.82%), repl-dce-sys2=976365.00 MB (93.14%), dce-App_sccmpri_40=597120.00 MB (28.48%), dce-App_11=219187.00 MB (10.45%), dce-App_10=231384.00 MB (11.03%), dce-App_sccmpri=1022512.00 MB (99.90%), dce-App_8=289373.00 MB (13.80%), dce-Images=408371.00 MB (99.76%), dce-App_5=347882.00 MB (16.59%), dce-App_6=309999.00 MB (14.78%), dce-App_3=391164.00 MB (18.65%), dce-App_1=351284.00 MB (16.75%), dce-App_4=309909.00 MB (14.78%), dce-Paging_1=925821.00 MB (44.15%), dce-Sys_2=428576.00 MB (20.44%), dce-Sys_1=225727.00 MB (10.76%), repl-dce-app4=1042083.00 MB (99.41%), dce-App_14=364505.00 MB (17.38%), dce-App_15=238971.00 MB (11.40%), dce-App_16=340026.00 MB (16.22%), dce-Sys_8=292825.00 MB (13.96%), dce-App_17_InfoSec=218130.00 MB (13.87%), dce-App_18_InfoSec=214559.00 MB (13.64%), dce-Sys_9=2008565.00 MB (87.11%), dce-App_19_smbcs=1454225.00 MB (69.35%), dce-App_20_smbdb=2095915.00 MB (99.95%)
[1435647778] SERVICE ALERT: myESXSERVERavm01.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435647838] SERVICE ALERT: myESXSERVERavm01.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=0.00 KB/s, send=0.00 KB/s, all 8 NICs are connected
[1435647881] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435647948] SERVICE ALERT: myESXSERVERvm06.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=2322.00 KB/s, send=563.00 KB/s, all 8 NICs are connected
[1435647968] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - HOST MEM Unknown error
[1435648027] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;CRITICAL;SOFT;2;ESX3 CRITICAL - HOST MEM Unknown error
[1435648061] SERVICE ALERT: myESXSERVERvm03.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435648088] SERVICE ALERT: myESXSERVERvm05.bose.com;Memory for VMHost;OK;SOFT;3;ESX3 OK - mem usage=597568.07 MB (56.99%), overhead=5722.32 MB, swapped=5.60 MB
[1435648127] SERVICE ALERT: myESXSERVERvm03.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=149.00 KB/s, send=8629.00 KB/s, all 8 NICs are connected
[1435648138] SERVICE ALERT: myESXSERVERavm01.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435648147] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;1;ESX3 CRITICAL - all 8 NICs are connected
[1435648198] SERVICE ALERT: myESXSERVERavm01.bose.com;Networking for VMHost;OK;SOFT;2;ESX3 OK - net receive=0.00 KB/s, send=0.00 KB/s, all 8 NICs are connected
[1435648208] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;2;ESX3 CRITICAL - all 8 NICs are connected
[1435648268] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;3;ESX3 CRITICAL - all 8 NICs are connected
[1435648328] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;SOFT;4;ESX3 CRITICAL - all 8 NICs are connected
[1435648388] SERVICE ALERT: myESXSERVERvm02.bose.com;Networking for VMHost;CRITICAL;HARD;5;ESX3 CRITICAL - all 8 NICs are connected

[tgriep]

I found an updated version of the check_esx3.pl plugin you may want to try.
https://github.com/shinken-monitoring/p ... ck_esx3.pl

This plugin has a new option that may fix the unknown errors that you are experiencing.

-T, --timestamp=<timeshift>
Timeshift in seconds that could fix issues with "Unknown error". Use values like 5, 10, 20, etc

Try it out and see if that fixes the error.

[bosecorp]

I have implemented the suggested changes. I am waiting to see if this helps

[tgriep]

Let us know if this work for you or not.

[bosecorp]

So far is working. I have not seen any new false alert. I will give it few more hours

[lmiltchev]

So far is working. I have not seen any new false alert. I will give it few more hours

Sure. Let us know. We will keep the topic open for a while.

[bosecorp]

it significantly improved the number of false alerts, but I still see few. I don't as many alerts as I used to see

[bosecorp]

you can go ahead and close this ticket. I do not see any alerts anymore