Notification Mess!

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
User avatar
rkane
Posts: 114
Joined: Wed Aug 15, 2018 3:56 pm

Re: Notification Mess!

Post by rkane »

No worries, really appreciate the help!
It seems to have gone through - how can i check the queue to make sure there's no more messages waiting to go out?
scottwilkerson wrote:Sorry about that they missed 2 characters

Code: Select all

echo "truncate table xi_events; truncate table xi_meta; truncate table xi_eventqueue;" | mysql -uroot -pnagiosxi nagiosxi
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Notification Mess!

Post by scottwilkerson »

There isn't a place to see them waiting other than looking at the database tables that command just deleted.

You can see any new ones being processed though by tailing the eventman.log

Code: Select all

tail -f /usr/local/nagiosxi/var/eventman.log
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
User avatar
rkane
Posts: 114
Joined: Wed Aug 15, 2018 3:56 pm

Re: Notification Mess!

Post by rkane »

So the messages are still coming through. Best I can tell our IronPort is refusing and Nagios is retrying...thoughts?
User avatar
rkane
Posts: 114
Joined: Wed Aug 15, 2018 3:56 pm

Re: Notification Mess!

Post by rkane »

For anyone finding this thread at a later date, here's a quick wrap up.

- Major outage caused NagiosXI to fire off thousands of email notifications
- Our IronPort started refusing and letting NagiosXI that it was doing so
- NagiosXI continued to try to deliver those notifications for days
- The IronPort would let a few through and then block, let a few through and then block

End result was what appeared to be a "random" notification issue

Solution: temporarily whitelist NagiosXI on the IronPort and wait a few days for NagiosXI to clear out the notification queue.

This thread can be closed unless someone on the Nagios end has any thoughts on how to clear that notification queue so that NagiosXI will stop retrying.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: Notification Mess!

Post by tgriep »

Login to the XI GUI and go to the Admin > Manage Email Settings menu to see what the Mail Method is set to.
If it is set to Sendmail, then the emails are coming from the local mailer daemons mail queue.
To clear out that queue, run the following as root.

Code: Select all

postsuper -d ALL
Be sure to check out our Knowledgebase for helpful articles and solutions!
User avatar
rkane
Posts: 114
Joined: Wed Aug 15, 2018 3:56 pm

Re: Notification Mess!

Post by rkane »

Done and done, is there a way to check that it has been properly cleared?
tgriep wrote:Login to the XI GUI and go to the Admin > Manage Email Settings menu to see what the Mail Method is set to.
If it is set to Sendmail, then the emails are coming from the local mailer daemons mail queue.
To clear out that queue, run the following as root.

Code: Select all

postsuper -d ALL
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: Notification Mess!

Post by tgriep »

Run this command and it will show you how many messages are in the mail queue.

Code: Select all

mailq
Be sure to check out our Knowledgebase for helpful articles and solutions!
User avatar
rkane
Posts: 114
Joined: Wed Aug 15, 2018 3:56 pm

Re: Notification Mess!

Post by rkane »

Excellent, thank you.
Thread closed!
tgriep wrote:Run this command and it will show you how many messages are in the mail queue.

Code: Select all

mailq
Locked