Scheduled downtime and missed Recovery notification.
Posted: Tue Jan 02, 2024 8:35 am
Hi everyone,
I am having issue with notifications when using scheduled downtime feature. Here is scenario:
1. Service went to HARD non-OK with notification sent out.
2. We are making periodical server maintenance with "Scheduled downtime" to disable any false positive notifications sent out.
3. Service on the host got recovered switched to HARD OK state. No notifications was sent out.
4. "Scheduled downtime" has been finished.
As a result notifications are still have non-resolved non-OK issues. Which are in fact false positive.
As a suggestion I am thinking of disabling all checks for the "Scheduled downtime", but we have 40+ checks which is quite big list for calling API and taking into account we have about a lot of servers and periodical job it could take long for automation.
Maybe there is more elegant solution?
Thanks!
I am having issue with notifications when using scheduled downtime feature. Here is scenario:
1. Service went to HARD non-OK with notification sent out.
2. We are making periodical server maintenance with "Scheduled downtime" to disable any false positive notifications sent out.
3. Service on the host got recovered switched to HARD OK state. No notifications was sent out.
4. "Scheduled downtime" has been finished.
As a result notifications are still have non-resolved non-OK issues. Which are in fact false positive.
As a suggestion I am thinking of disabling all checks for the "Scheduled downtime", but we have 40+ checks which is quite big list for calling API and taking into account we have about a lot of servers and periodical job it could take long for automation.
Maybe there is more elegant solution?
Thanks!