Self un-Acknowledgment

[JohnFLi]

Just finished a 4-day weekend......
Through out my weekend, 1 service went into a critical state.... It was something that could wait till I returned. So I remoteded in, acknowledged it and went on my merry way.....
Nagios had other ideas.....

when looking that the notification log..... I see where it alerted on being critical, I responded to it.....then it would send a warning 6 min later, and start with the criticals 5 min after that.
I ended up needing to disable alerts for that service to get it to shut up.


After a short time, it would start alerting again....it hadn't recovered, so it should not have restarted complaining again. Any ideas why it would do that? Other than missing me not being at work?

[lmiltchev]

Can you post screenshots of State History and Notifications reports showing the service in question during this timeperiod?

[JohnFLi]

Warnings are set at 93% and critical at 95%

cDrive.jpg

[lmiltchev]

Did the service recover sometime between 02:00:02 and 03:26:17, and 03:55:01 and 04:01:04? You didn't show us a screenshot from the "State History" report...

[JohnFLi]

cDriveb.jpg

between 2 and 3:26 it remained silent....but it it did start bleating again at 3:26

[scottwilkerson]

Do you have is_volitile set for the service either in the definition or an underlying template?

http://nagios.sourceforge.net/docs/nagi ... vices.html

[JohnFLi]

No I do not. It is just a hard drive check, nothing fancy

[jdalrymple]

This *looks* to me like you didn't check the sticky acknowledgment checkbox. Did you/Do you?

[JohnFLi]

Didn't do anything different that what I've done any other time I acknowledged an alert.
It's defaulted to being 'sticky'

[jdalrymple]

I think in order to understand better what happened there we'll have to sort through your nagios.log about that time.

It might be more desirable if you can recreate the issue - but if not can we grab the logs around one of the times you experienced the problem over the weekend?

Maybe a full service definition too including any templates you have customized.

You're right - if sticky notifications was checked then the behavior you have depicted is improper. Head scratcher.