Page 1 of 2

Notifications not being sent

Posted: Tue May 19, 2020 11:38 am
by BanditBBS
OK, so I have a passive service setup like so:
service.jpg
The notification interval is 0 as we send them to ticket system and tickets are auto created so only need 1 notification. This particular service has a habit of going bad and then resolving itself so on April 3rd I put that first notification delay of 15 in. Ever since then no notifications have been sent. Today the service was critical for 8 hours and nothing.

Is there a bug/undocumented feature when using both 0 interval and delaying the first notification?

Re: Notifications not being sent

Posted: Wed May 20, 2020 10:10 am
by cdienger
What is check_interval set to? The notification_interval will trigger a notification on the NEXT check if it's value is less than or equal to the check interval value.

Re: Notifications not being sent

Posted: Wed May 20, 2020 10:17 am
by BanditBBS
check.jpg
This is the configuration on that screen. Notice that active checks are off, this is a passive check that runs every 10 minutes on the host.

Re: Notifications not being sent

Posted: Wed May 20, 2020 2:26 pm
by cdienger
Thanks for the update. I initially missed the part where it was mentioned that this was a passive service. I'll set it up to check. Is this a still a 5.6.8 install?

Re: Notifications not being sent

Posted: Wed May 20, 2020 2:39 pm
by BanditBBS
Nope, sorry, need to update signature. 5.6.14!

Re: Notifications not being sent

Posted: Thu May 21, 2020 11:37 am
by cdienger
So the issue here is that notification delays expect at least one more trap to come in(at least 15 minutes later) to be triggered. Without that the notification will not occur.

What we can do is use the freshness check to force a second check X seconds later where X is the notification delay. The freshness check will run check_dummy with the $SERVICESTATEID$ and $SERVICEOUTPUT$ macros which will have the values from the initial passive snmp trap.

Re: Notifications not being sent

Posted: Fri May 22, 2020 2:12 pm
by BanditBBS
But would that freshness check actually ever run? The passive results are coming in every 5 minutes. Let me clarify my issue to make sure I explained it properly.
-----------------------------------------------------------
Host is actively checked for ping every 5 minutes
Host has about 10 services defined on it that are all passive.
nrdp runs every 5 minutes on the host and sends the results back to the XI server.
One of the services is a service check that the service quite often goes down but comes back upon its own in 5 minutes or so, rendering the notifications useless.
Changed delay first notification to 15 to HOPEFULLY result in a delay of 15 minutes so the OK result can be sent in and stop any notifications from being sent.
This has been working great(we thought) until recently when we notices the service check has been critical for over 8 hours.
In those 8 hours the host was sending the passive check results in every 5 minutes, no notification was every triggered
-----------------------------------------------------------

Thanks!

Re: Notifications not being sent

Posted: Fri May 22, 2020 2:21 pm
by cdienger
Thanks for the clarification. It wasn't clear that the checks were coming in every 5 minutes. In this case the freshness threshold would not be met. I'll take another look into this with this behavior in mind and let you know what I find.

Re: Notifications not being sent

Posted: Thu May 28, 2020 11:15 am
by BanditBBS
Hey @cdienger, any update on your findings?

Re: Notifications not being sent

Posted: Thu May 28, 2020 5:01 pm
by cdienger
Yes, it looks like it will behave the way you want with the delay if you set it to be a volatile service.