Page 1 of 1

Host recovery emails being sent while host is in downtime

Posted: Mon Jul 06, 2015 9:24 am
by mlbsysops
Hey guys,

We seem to be getting host recovery emails even though the host is in downtime.

Edit: This is on Nagios XI version R2.7.

From: [email protected]
Received: Monday, 06 Jul 2015, 9:19AM

To: MM - Infrastructure
Subject: ** RECOVERY Host Alert: NetworkStream is UP **

***** Nagios Monitor XI Alert *****

Notification Type: RECOVERY
Host: NetworkStream
State: UP
Address: <IP ADDRESS>
Info: OK - <IP ADDRESS>: rta 31.296ms, lost 20%

Now the Alert settings for the MM - Infrastrucutre contact are the following:

Host Notifications Enabled: On
Host Notifications Time period: workhours
Host Notification options (checked options): d; r; f; s
Manage host Notifications Commands: notify-host-by-email

It's my understanding that if a host is placed in downtime along with it's services there shouldn't be any notifications sent until the host comes out of downtime (In this current example the host is still in downtime and has been since yesterday evening).

Re: Host recovery emails being sent while host is in downtim

Posted: Mon Jul 06, 2015 12:33 pm
by tmcdonald
Did the host go into a non-OK state before the downtime was scheduled? If this is the case, I do believe you will still get a recovery notification regardless of whether it is in downtime or not.

See this bug report for more:

https://tracker.nagios.org/view.php?id=294
The reason is quite simple; Lots of people (in the realms of 300.000 or so) set up their Nagios servers to send email notifications. They may have downtime windows that occur during the night and are automatically scheduled or whatnot. Let's pretend they start at 02.00 every monday morning and end a 06.00 the same morning. Most people also configure their Nagios servers to only send text-messages during non-business hours for the *really* important stuff, where getting waken once or twice for a false alarm is better than not getting the notification at all. So most of their alerts go to mail. They would be mightily terrified if they saw an alert without a corresponding recovery in their mailbox in the morning (as we noticed when we patched it to behave the way you say it should).

Re: Host recovery emails being sent while host is in downtim

Posted: Mon Jul 06, 2015 1:27 pm
by mlbsysops
Thanks, seems though some users are reporting that they're still getting alert emails from a couple of hosts that are currently in downtime.

** PROBLEM Host Alert: STL-COM-OP-04 is DOWN **

***** Nagios Monitor XI Alert *****

Notification Type: PROBLEM
Host: STL-COM-OP-04
State: DOWN
Address: <IP ADDRESS>
Info: CRITICAL - <IP ADDRESS>: rta nan, lost 100%

Date/Time: Mon Jul 6 12:34:46 EDT 2015

The host went hard down around 9:50 EDT and was placed in downtime at 10:07 EDT.

Thanks,

Re: Host recovery emails being sent while host is in downtim

Posted: Mon Jul 06, 2015 2:00 pm
by lmiltchev
You opened a new support ticket in our ticketing system. We will continue communicating via emails. I am locking this topic.