"HOST UP" flood after Nagios Core update

Support forum for Nagios Core, Nagios Plugins, NCPA, NRPE, NSCA, NDOUtils and more. Engage with the community of users including those using the open source solutions.
madsantos
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

"HOST UP" flood after Nagios Core update

Post by madsantos »

Hi,
Last week I updated Nagios Core from 4.2.0 to 4.4.0 on one of my machines. Over the weekend I received a flood of notifications, all of them saying the host was UP. There was no "HOST DOWN" associated message and in fact, the machine was never down during that time. The problem still persists and I have no idea what is causing it. I updated 2 more machines and guess what, they started flooding Nagios and my smartphone with host notifications as well...so I'm pretty sure this has to do with the update. I'm kind of lost, I haven't changed any configuration files. Any ideas?

Thanks
bheden
Product Development Manager
Posts: 179
Joined: Thu Feb 13, 2014 9:50 am
Location: Nagios Enterprises

Re: "HOST UP" flood after Nagios Core update

Post by bheden »

Can you PM me a tarball of your configuration files?

We're getting ready to release Core 4.4.1, as there were some issues in the 4.4.0 release that weren't caught in testing. Are you able to test this installation with the maint branch of Core on GitHub? (https://github.com/NagiosEnterprises/na ... tree/maint)
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.

Nagios Enterprises
Senior Developer
madsantos
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Post by madsantos »

bheden wrote:Can you PM me a tarball of your configuration files?

We're getting ready to release Core 4.4.1, as there were some issues in the 4.4.0 release that weren't caught in testing. Are you able to test this installation with the maint branch of Core on GitHub? (https://github.com/NagiosEnterprises/na ... tree/maint)
Hi bheden, unfortunately I do not have permission to test any installation or send any files, as the aforementioned machines are on a production environment and the content is confidential. I'm sorry I cannot help you on that issue, it's out of my hands. Part of my job is to guarantee that every machine is up to date, so yesterday I updated every machine and they started showing the same symptoms as well, indicating there is indeed some kind of incompatibility/bug with the 4.4.0 release.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: "HOST UP" flood after Nagios Core update

Post by scottwilkerson »

4.4.1 has been release which we believe has a fix for the problem you were experiencing.
Former Nagios employee
Creator:
ahumandesign.com
enneagrams.com
madsantos
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Post by madsantos »

scottwilkerson wrote:4.4.1 has been release which we believe has a fix for the problem you were experiencing.
Thanks Scott, will upgrade and send you some feedback afterwards. Cheers.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: "HOST UP" flood after Nagios Core update

Post by scottwilkerson »

Thanks!
Former Nagios employee
Creator:
ahumandesign.com
enneagrams.com
madsantos
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Post by madsantos »

scottwilkerson wrote:Thanks!
Hi again, unfortunately it didn't solve the spamming. I wish I could provide more help, but I was advised not to share any compromising details. All I can guess is that for some reason, Nagios doesn't save the previous state and "thinks" there was a state change, notifying the host is up every check. Maybe it could have to do with the check plugin?
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: "HOST UP" flood after Nagios Core update

Post by scottwilkerson »

Is it continuous every single host check sends an UP notification?

If you look at the state history, does it show the host ever going into a non-ok state?

Does the notifications report show all of these?

Without giving any details away, does the event log show anything that stands out as odd?
Former Nagios employee
Creator:
ahumandesign.com
enneagrams.com
madsantos
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Post by madsantos »

scottwilkerson wrote:Is it continuous every single host check sends an UP notification?

If you look at the state history, does it show the host ever going into a non-ok state?

Does the notifications report show all of these?

Without giving any details away, does the event log show anything that stands out as odd?
Hi Scott, thanks for your time and effort.

Below are some prints of the notifications report and one of the servers, showing that despite there was no state change since yesterday, 1100 notifications were sent. The event log seems perfectly normal.

https://i.imgur.com/lm5RrG8.png
https://i.imgur.com/6zGiqjF.png
https://i.imgur.com/q44zRIZ.png

Cheers
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: "HOST UP" flood after Nagios Core update

Post by scottwilkerson »

Is this all hosts or every time a single host checks?

Because this image is only showing a HOST alert every 5 minutes
https://imgur.com/q44zRIZ
Former Nagios employee
Creator:
ahumandesign.com
enneagrams.com
Locked