Page 1 of 5

Notifications not being received

Posted: Tue Nov 06, 2018 4:21 pm
by snapon_admin
How would I figure out why Nagios is saying email notifications are being sent that are not being received? I ran a notification report for one of our hosts that was down early this morning and according to the report a critical email was sent to me at 12:05, 1:07, 2:08 and 3:10 with the recovery email coming at 3:25. Another user reported that they did not receive any emails on this host during that time. Another user did not recieve the 12:05 notification, but did receive the others. According to the report all 3 contacts were all sent the same notifications but we all had various success with actually receiving them. What do?

Sorry, forgot version 5.4.13. Can send profile if needed.

Re: Notifications not being received

Posted: Tue Nov 06, 2018 4:41 pm
by npolovenko
Hello, @snapon_admin. What are you using as a mailing engine? Sendmail or SMTP? Perhaps some of the Nagios emails are falling in a spam folder or getting blocked by your mailing provider. And the notification report specifically says that notifications were sent out to each contact, correct?

Re: Notifications not being received

Posted: Tue Nov 06, 2018 5:02 pm
by snapon_admin
SMTP, the messages are definitely not getting dumped into any spam filters or blocked or anything like that. Yes, the report shows the emails being sent to each contact.

Re: Notifications not being received

Posted: Tue Nov 06, 2018 5:13 pm
by npolovenko
Hello, @snapon_admin. Could you send in your system profile? + Let me know a) names of services that were sending notifications b) names of contacts that haven't recieved notifications. To send us your system profile.
Login to the Nagios XI GUI using a web browser.
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and send it in a private message.
After you send in the profile please post something in this thread to bring it back up in the support queue.

Also, I suggest checking the error logs on the SMTP server.

Profile recieved and shared with the support team

Re: Notifications not being received

Posted: Wed Nov 07, 2018 2:20 pm
by snapon_admin
Profile sent.

Re: Notifications not being received

Posted: Wed Nov 07, 2018 3:34 pm
by npolovenko
@snapon_admin, I haven't seen anything wrong on the config side. Have you always had problems with notifications or it just started recently?
I noticed that the boot partition is 100% full on this server, and I've also seen DB corruption errors in the logs:
/dev/sda1 97M 92M 314K 100% /boot
Please expand the /boot partition or clean up the space and run the repair DB command:
mysqlcheck -r -f -uroot -pnagiosxi --all-databases

Re: Notifications not being received

Posted: Wed Nov 07, 2018 3:45 pm
by snapon_admin
Not sure how the boot partition would have even changes size. How do I know what is safe to remove from that partition? This notification issue is new, started, near as we can tell, maybe 3 weeks ago....ish. Running DB repair now.

Re: Notifications not being received

Posted: Wed Nov 07, 2018 4:32 pm
by ssax
Generally /boot will only contain updated initramfs images and boot kernels, as you run yum update it is likely regenerating and creating new ones to match:

Please see here for a solution that may work for you:

https://unix.stackexchange.com/a/105029

Please go to Admin > Manage Email Settings, make sure Debug Log is checked, and click the Update Settings button.

Then run this tail command (and leave it running), replicate the issue, and then post the entire tail command output for review:

Code: Select all

tail -F /var/log/maillog /usr/local/nagiosxi/tmp/phpmailer.log /usr/local/nagiosxi/var/eventman.log

Re: Notifications not being received

Posted: Tue Nov 13, 2018 12:15 pm
by snapon_admin
I c an't really replicate the issue on demand. It seems to randomly happen. I just got another call from Operations stating that they didn't receive and email that Nagios says was sent, but they have gotten other emails. I can leave the tail running awhile and hope it happens, but that's about it.

Re: Notifications not being received

Posted: Tue Nov 13, 2018 12:23 pm
by snapon_admin
I might have just gotten lucky, I think it happened again while running the tail. An email was sent, and operations is saying they did not receive it. Tail attached (too many characters to copy+paste.