"HOST UP" flood after Nagios Core update

An open discussion forum for obtaining help with Nagios Core. Nagios Core users of all experience levels are welcome here. Subforum have been created for the discussion of Nagios Core and Nagios Plugin development.

NOTE: The SourceForge.net mailing lists have been deprecated in favor of this forum in order to expedite support and provide additional features not available on the old mailing list.

"HOST UP" flood after Nagios Core update

Postby madsantos » Mon Jun 25, 2018 10:57 am

Hi,
Last week I updated Nagios Core from 4.2.0 to 4.4.0 on one of my machines. Over the weekend I received a flood of notifications, all of them saying the host was UP. There was no "HOST DOWN" associated message and in fact, the machine was never down during that time. The problem still persists and I have no idea what is causing it. I updated 2 more machines and guess what, they started flooding Nagios and my smartphone with host notifications as well...so I'm pretty sure this has to do with the update. I'm kind of lost, I haven't changed any configuration files. Any ideas?

Thanks
madsantos
 
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Postby bheden » Mon Jun 25, 2018 12:24 pm

Can you PM me a tarball of your configuration files?

We're getting ready to release Core 4.4.1, as there were some issues in the 4.4.0 release that weren't caught in testing. Are you able to test this installation with the maint branch of Core on GitHub? (https://github.com/NagiosEnterprises/na ... tree/maint)
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.

Nagios Enterprises
Product Development Manager
User avatar
bheden
Product Development Manager
 
Posts: 167
Joined: Thu Feb 13, 2014 9:50 am
Location: Nagios Enterprises

Re: "HOST UP" flood after Nagios Core update

Postby madsantos » Tue Jun 26, 2018 5:00 am

bheden wrote:Can you PM me a tarball of your configuration files?

We're getting ready to release Core 4.4.1, as there were some issues in the 4.4.0 release that weren't caught in testing. Are you able to test this installation with the maint branch of Core on GitHub? (https://github.com/NagiosEnterprises/na ... tree/maint)


Hi bheden, unfortunately I do not have permission to test any installation or send any files, as the aforementioned machines are on a production environment and the content is confidential. I'm sorry I cannot help you on that issue, it's out of my hands. Part of my job is to guarantee that every machine is up to date, so yesterday I updated every machine and they started showing the same symptoms as well, indicating there is indeed some kind of incompatibility/bug with the 4.4.0 release.
madsantos
 
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Postby scottwilkerson » Tue Jun 26, 2018 6:21 am

4.4.1 has been release which we believe has a fix for the problem you were experiencing.
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
User avatar
scottwilkerson
DevOps Engineer
 
Posts: 12248
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: "HOST UP" flood after Nagios Core update

Postby madsantos » Tue Jun 26, 2018 9:21 am

scottwilkerson wrote:4.4.1 has been release which we believe has a fix for the problem you were experiencing.


Thanks Scott, will upgrade and send you some feedback afterwards. Cheers.
madsantos
 
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Postby scottwilkerson » Tue Jun 26, 2018 9:22 am

Thanks!
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
User avatar
scottwilkerson
DevOps Engineer
 
Posts: 12248
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: "HOST UP" flood after Nagios Core update

Postby madsantos » Tue Jun 26, 2018 10:03 am

scottwilkerson wrote:Thanks!


Hi again, unfortunately it didn't solve the spamming. I wish I could provide more help, but I was advised not to share any compromising details. All I can guess is that for some reason, Nagios doesn't save the previous state and "thinks" there was a state change, notifying the host is up every check. Maybe it could have to do with the check plugin?
madsantos
 
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Postby scottwilkerson » Tue Jun 26, 2018 10:08 am

Is it continuous every single host check sends an UP notification?

If you look at the state history, does it show the host ever going into a non-ok state?

Does the notifications report show all of these?

Without giving any details away, does the event log show anything that stands out as odd?
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
User avatar
scottwilkerson
DevOps Engineer
 
Posts: 12248
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: "HOST UP" flood after Nagios Core update

Postby madsantos » Tue Jun 26, 2018 10:37 am

scottwilkerson wrote:Is it continuous every single host check sends an UP notification?

If you look at the state history, does it show the host ever going into a non-ok state?

Does the notifications report show all of these?

Without giving any details away, does the event log show anything that stands out as odd?


Hi Scott, thanks for your time and effort.

Below are some prints of the notifications report and one of the servers, showing that despite there was no state change since yesterday, 1100 notifications were sent. The event log seems perfectly normal.

https://i.imgur.com/lm5RrG8.png
https://i.imgur.com/6zGiqjF.png
https://i.imgur.com/q44zRIZ.png

Cheers
madsantos
 
Posts: 18
Joined: Fri Apr 27, 2018 5:26 am

Re: "HOST UP" flood after Nagios Core update

Postby scottwilkerson » Tue Jun 26, 2018 10:57 am

Is this all hosts or every time a single host checks?

Because this image is only showing a HOST alert every 5 minutes
https://imgur.com/q44zRIZ
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
User avatar
scottwilkerson
DevOps Engineer
 
Posts: 12248
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Next

Return to Nagios Core

Who is online

Users browsing this forum: No registered users and 29 guests