Good grief..... I am at a larger loss than before....
ok, here is the log since I sent debug to 32. (G1VPSQL15, and G1VPSPS01 are both off and set as in downtime. G1VPOSS02 I stopped the NSClient to force valid notifications)
Code: Select all
[1407860309.385096] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860309.385101] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860345.341030] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'CPU_Load', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860345.341046] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860345.341057] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860364.335019] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'C:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860364.335053] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860364.335058] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860365.337301] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'UpTime', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860365.337331] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860365.337336] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860372.333235] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'CPU_Load', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860372.333270] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860372.333275] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860375.349216] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860375.349229] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860375.349233] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860394.349069] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSPS01', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860394.349084] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860394.349089] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860418.334129] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'E:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860418.334173] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860418.334179] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860448.341104] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860448.341122] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860448.341127] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860464.343580] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'UpTime', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860464.343597] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860464.343602] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860464.343778] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'E:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860464.343787] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860464.343792] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860494.350543] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSPS01', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860494.350559] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860494.350563] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860497.333491] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'F:\ Drive Space 85/90', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860497.333528] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860497.333534] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860527.341081] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860527.341098] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860527.341103] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860542.339010] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'C:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860542.339025] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860542.339030] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860572.354122] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860572.354142] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860572.354146] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860576.346120] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'Memory Usage', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860576.346136] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860576.346140] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860578.337173] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'Memory Usage', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860578.337209] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860578.337214] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860606.354165] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860606.354184] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860606.354189] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860608.346088] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSPS01', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860608.346103] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860608.346107] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860645.317746] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'CPU_Load', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860645.317793] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860645.317799] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860664.311372] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'C:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860664.311410] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860664.311416] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860665.314152] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'UpTime', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860665.314190] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860665.314196] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860672.309558] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'CPU_Load', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860672.309598] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860672.309605] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860675.326020] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860675.326032] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860675.326037] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860694.320017] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSPS01', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860694.320033] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860694.320037] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860718.310984] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'E:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860718.311025] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860718.311031] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860748.319129] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860748.319156] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860748.319161] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860764.320053] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'UpTime', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860764.320092] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860764.320098] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860764.321082] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'E:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860764.321128] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860764.321134] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860794.331225] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSPS01', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860794.331249] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860794.331254] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860797.310438] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'F:\ Drive Space 85/90', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860797.310474] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860797.310480] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860827.318083] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860827.318103] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860827.318108] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860842.315172] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'C:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860842.315210] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860842.315216] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860872.322049] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860872.322067] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860872.322072] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860876.323408] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'Memory Usage', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860876.323444] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860876.323450] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860878.313928] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSPS01', Service: 'Memory Usage', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860878.313965] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860878.313970] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860906.330026] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSQL15', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860906.330043] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860906.330048] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860908.321066] [032.0] [pid=17742] ** Host Notification Attempt ** Host: 'G1VPSPS01', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Wed Dec 31 16:00:00 1969
[1407860908.321084] [032.1] [pid=17742] This host problem has already been acknowledged, so we won't send a notification out!
[1407860908.321089] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407860945.294676] [032.0] [pid=17742] ** Service Notification Attempt ** Host: 'G1VPSQL15', Service: 'CPU_Load', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407860945.294729] [032.1] [pid=17742] The host is either down or unreachable, so we won't notify contacts about this service.
[1407860945.294734] [032.0] [pid=17742] Notification viability test failed. No notification will be sent out.
[1407861896.028673] [032.0] [pid=6463] ** Service Notification Attempt ** Host: 'G1VPOSS02', Service: 'C:\ Drive Space', Type: NORMAL, Options: 0, Current State: 2, Last Notification: Wed Dec 31 16:00:00 1969
[1407861896.028703] [032.1] [pid=6463] The host is either down or unreachable, so we won't notify contacts about this service.
[1407861896.028711] [032.0] [pid=6463] Notification viability test failed. No notification will be sent out.
[1407861896.030447] [032.0] [pid=6463] ** Host Notification Attempt ** Host: 'G1VPOSS02', Type: NORMAL, Options: 0, Current State: 1, Last Notification: Tue Aug 12 09:43:56 2014
[1407861896.030463] [032.1] [pid=6463] Its not yet time to re-notify the contacts about this host problem...
[1407861896.030471] [032.1] [pid=6463] Next acceptable notification time: Tue Aug 12 09:48:56 2014
[1407861896.030476] [032.0] [pid=6463] Notification viability test failed. No notification will be sent out.
If you view the attachment, bogus emails had been sent.