Notification not sent

[markmerchant]

Expected recovery notification not sent. Why is this? And, how to fix? I have
seen recovery alerts from this host before. Thx.

Code: Select all

/usr/local/nagios/var/alert.log
    Flapping Stop     9/5/2019 9:38    HOST FLAPPING ALERT: xxxxxxxxxx;     STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
    Host Recovery     9/5/2019 8:04    HOST ALERT:          xxxxxxxxxx;     UP;SOFT;1;FPING OK - 10.xxx.xx.xx (loss=0%, rta=66.100000 ms)
    Host Down         9/5/2019 8:03    HOST ALERT:          xxxxxxxxxx;     DOWN;SOFT;1;FPING CRITICAL - 10.xxx.xx.xx (loss=100% )
    Host Recovery     9/5/2019 7:03    HOST ALERT:          xxxxxxxxxx;     UP;HARD;1;FPING OK - 10.xxx.xx.xx (loss=0%, rta=66.200000 ms)
    Runtime Warning   9/5/2019 7:03    HOST FLAPPING ALERT: xxxxxxxxxx;     STARTED; Host appears to have started flapping (22.1% change > 20.0% threshold)
    Host Down         9/5/2019 6:58    HOST ALERT:          xxxxxxxxxx;     DOWN;HARD;3;FPING CRITICAL - 10.xxx.xx.xx (loss=100% )
    Host Notification 9/5/2019 6:58    HOST NOTIFICATION:   servicenow-soap;xxxxxxxxxx;DOWN;send-host-soap-sn;FPING CRITICAL - 10.xxx.xx.xx (loss=100% )
    Host Notification 9/5/2019 6:58    HOST NOTIFICATION:   servicenow-soap;xxxxxxxxxx;DOWN;send-host-soap-test;FPING CRITICAL - 10.xxx.xx.xx (loss=100% )

/usr/local/nagios/etc/hosts/xxxxxxxxxx.cfg
    define host{
    use generic-vmware-host
    address 10.xxx.xx.xx
    register 1
    host_name xxxxxxxxxx
    alias xxxxxxxxxx.xx.xxx
    }

/usr/local/nagios/etc/hosttemplates.cfg
    define host{
        flap_detection_enabled 1
        event_handler_enabled 0
        notifications_enabled 1
        process_perf_data 1
        notification_period 24x7
        contacts servicenow-soap
        retain_status_information 1
        max_check_attempts 3
        notification_options d,u,r,
        retain_nonstatus_information 1
        name generic-vmware-host
        register 0
        check_command check-fast-alive!!!!!!!!
        notification_interval 0
        alias CONTACT SERVER SUPPORT
        }

/usr/local/nagios/etc/contacts.cfg
    define contact{
        contact_name servicenow-soap
        host_notification_commands send-host-soap-sn,send-host-soap-test
        host_notification_period 24x7
        service_notification_period 24x7
        host_notification_options d,u,r,
        service_notification_commands no-command
        service_notification_options w,u,c,r,
        host_notifications_enabled 1
        service_notifications_enabled 1
        alias SOAP mesg to ServiceNow
        }

[tgriep]

One thing I see is that the Host is Flapping and one of the built in functions in Nagios is if a Host or Service is Flapping, it will not send Notifications until the Flapping stops. See this link.
https://assets.nagios.com/downloads/nag ... pping.html

Did the host finally recover and stop flapping?
After the Flapping Stop message, did the host go down and recover without flapping?

[markmerchant]

The host is in a far network. Typically there is some flapping early in the
morning which resolves within 20-30 mins then is fine for the rest of the
day. As of now it is up with no flapping.

[tgriep]

Has that Host ever go Down and Recover without going in to a Flapping state?

If so, did it send the Recovery Notification?

Also, upgrade the server to the latest version of XI as there were some issues fixed that could cause the Notifications to not get generated when they should be.
https://assets.nagios.com/downloads/nag ... ctions.pdf

[markmerchant]

Thx, will schedule update then get back to you.

[ssax]

Sounds good, we'll keep an eye out.

Please answer these as well:

Has that Host ever go Down and Recover without going in to a Flapping state?

If so, did it send the Recovery Notification?