Page 1 of 2
I get 10 emails notifications for some alerts
Posted: Mon Feb 24, 2020 2:57 pm
by typer100
All emails are the same. Same date/time. SAme content.
Nagios XI 5.6.10
Re: I get 10 emails notifications for some alerts
Posted: Mon Feb 24, 2020 4:25 pm
by benjaminsmith
Hello
@typer100,
Let's do a full restart of the software stack to make sure you do not have multiple Nagios processes running. For Cent/RHEL 7, the commands are as follows:
Code: Select all
systemctl stop crond
systemctl stop npcd
systemctl stop nagios
systemctl stop ndo2db
pkill -9 -u nagios
for i in $(ipcs -q | grep nagios |awk '{print $2}'); do ipcrm -q $i; done
rm -rf /usr/local/nagiosxi/var/dbmaint.lock
rm -rf /usr/local/nagiosxi/var/event_handler.lock
rm -rf /usr/local/nagiosxi/scripts/reconfigure_nagios.lock
systemctl restart mariadb
systemctl start ndo2db
systemctl start nagios
systemctl start npcd
systemctl start crond
If the issue persisst, let me kow the exact host or service sending out too many messages and I'll track it down in the system profile.
Also, if you are using SMPT server for email, please enable debugging. Go to Admin > System Config > Email Setting > Enable logging of mail sent with the internal mail component (PHPMailer) /usr/local/nagiosxi/tmp/phpmailer.log
Thanks.
To send us your system profile.
Login to the Nagios XI GUI using a web browser
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and share this in a private message and then
reply to this post to bring it up in the queue.
Re: I get 10 emails notifications for some alerts
Posted: Tue Feb 25, 2020 1:41 pm
by typer100
I'll try this report later
Re: I get 10 emails notifications for some alerts
Posted: Tue Feb 25, 2020 2:48 pm
by lmiltchev
All emails are the same. Same date/time. SAme content.
Nagios XI 5.6.10
Are they sent to the same user (contact)? How many monitoring contact are currently added to this host/service?
I'll try this report later
Sure, let us know when the profile is sent. Thanks!
Re: I get 10 emails notifications for some alerts
Posted: Thu Mar 05, 2020 9:06 am
by typer100
You can look for this alert:
***** Nagios XI Alert *****
Nagios has detected a problem with this service.
Notification Type: PROBLEM
Service: Swap Usage
Host: slpelk0677
Address: 172.21.4.56
State: CRITICAL
Info:
CRITICAL: Used swap was 95.10 % (Total: 2147.48 MB, Used: 2041.23 MB, Free: 106.25 MB)
Date/Time: 2020-03-05 06:27:11
Moderator's Note: The profile has been shared with the support team but has been removed from the public forum.
Re: I get 10 emails notifications for some alerts
Posted: Thu Mar 05, 2020 10:00 am
by lmiltchev
In the service template that is used in "Swap Usage", there is one contact, and two contact groups defined. The contact groups have 15 members (contacts) total, assigned to them. For some of them, notifications are disabled but it is hard to find our what the issue is, since we don't have all of the information.
Is this notification sent to the same contact (email) 10 times or it is sent to 10 different contacts at the same time? What are the contacts that received this email? Are you using distribution lists?
Important: I would like to point out that you are NOT using the default notification handlers. Your contact uses custom notification commands -
notify-host-by-opsgenie and
notify-service-by-opsgenie.
If you are sending notifications to an external program, e.g.
Opsgenie, then this is out of scope of Nagios Support. We cannot help you with configuring Opsgenie.
Re: I get 10 emails notifications for some alerts
Posted: Thu Mar 05, 2020 10:41 am
by typer100
Hi! Critical alerts are sent to one contact (OpsGenie) for our ticket management in via Opsgenie to ServiceNow.
And also, for that specific alert, to 2 contact groups via email.
Some contacts in these groups will have notification on or off.
Those with the notification set to ON, will receive the same alert via email up to 10 times.
*see attachment*
Re: I get 10 emails notifications for some alerts
Posted: Thu Mar 05, 2020 10:50 am
by lmiltchev
Those with the notification set to ON, will receive the same alert via email up to 10 times.
Can you go to
Reports > Available Reports > Notifications, and show a screenshot of that page, showing multiple notifications, sent to the same contact (email) at the same time?
Re: I get 10 emails notifications for some alerts
Posted: Fri Mar 06, 2020 6:27 am
by typer100
No. Only once.
Re: I get 10 emails notifications for some alerts
Posted: Fri Mar 06, 2020 9:58 am
by lmiltchev
No. Only once.
This means nagios is NOT sending multiple notifications for the same alert at the same time. Once the email is sent to Opsgenie -> ServiceNow, we don't have control over it. Troubleshooting 3rd party ticketing systems/notifications is out of scope of Nagios support. I would recommend that you contact the person who configured Opsgenie and/or ServiceNow, and ask him/her to troubleshot the issue on that end. Thank you!