postponed alert notification

[MichielvM]

A few of my admins brought this to my attention:

A device enters a state which should result in Nagios sending out an alert e-mail immediately.
On a number of devices this is postponed until after midnight.
I've been looking in time periods, alert settings, contacts,but all checks out normal. The e-mail should go out but doesn't.
The maillog does not show any mails sent until after 0 hour, next day.

What am I missing?

[tmcdonald]

Go to Home -> Notifications and search around the time the alert should have gone out. Is the notification listed there or at midnight?

[MichielvM]

Just checked it.

This afternoon shortly after 1300 hours the host entered a critical state. Then there's a gap until 00:02 when it start to send notifications.
Postfix maillog confirms this.

I don't get it. Timeperiods, Alert settings, Notification templates, all the usual suspects check ok.
By the way, this happens with Windows (NSclients) and Linux (SNMP) hosts.

Any thoughts highly appreciated.

Good night from my side of the pond.

[slansing]

Hmm, the type of checks shouldn't matter as much as the configurations themselves. Are you saying this only occurs on those types of hosts/services, and not on others you have set up? If you go to one of those host details pages, then the advanced tab, and send a custom notification, does it send immediately? I'd be interested in seeing your profile.zip, along with an example name of one of your trouble hosts/services to check. You can either PM one of us your profile, or open a support ticket and attach it there. The profile is downloadable from Admin > System Profile > Download. Just be sure not to attach it directly here in a reply.

[sreinhardt]

Do you have any host escalations on that object? Would you be able to send a system profile to one of us for verification, along with a host\service name or two that are doing this?

[MichielvM]

Custom notification isn't sent out and not visible in Home > Notifications unless I check Forced.
The broadcast check does not make a difference.

Other hosts/services receive notifications.
So it boils downs to some hosts/services on some NagiosXi environments.

I'll PM a copy of the profile to slansing, since he was the first to ask.

[slansing]

Could we grab some example names of hosts/services you are seeing this with? And one that you are not? That would make digging through this a bit easier .

[MichielvM]

PM

[slansing]

Great, I'm taking a look through.

Edit: I can't find that host in your configurations...hmmm..is that the only host you are seeing this with? It is curious that it is not listed in your configurations, if you open up a new profile.zip, does that host show? If you have since removed the host, it wont help me as I need to see a current configuration of one of your host/service pairs, one that is currently displaying this behavior.

[MichielvM]

I see it, the host I mentioned isn't attached to that server. My mistake.
We're pursuing a hunch at the moment with a custom timeperiod.

I'll let you know how that works out.