Need to dealy the mail notifications

[udaykumar]

Hello Team,

We have some services which are generating notifications continuously (receiving bulk in a day) even when we kept the notification interval to 480 minute.

For that services, we have check interval is 2 min, retry interval is 1 min, max check attempts is 3.

Can you please let us know how to reduce the flow of mails to users.
we are using the version 5.2.0

[dwhitfield]

It could be that your database is messed up. Do you know if you are using postgres or mysql? It also could be that the service is actually flapping. Are the notifications the exact same thing or do some of them say Up and others say Down (or Warning/Critical vs Ok)

Whether you know or not, can you PM me your Profile? You can download it by going to Admin > System Config > System Profile and click the ***Download Profile*** button towards the top. If for whatever reason you *cannot* download the profile, please put the output of View System Info (5.3.4+, Show Profile if older) in the thread (that will at least get us some info). This will give us access to many of the logs we would otherwise ask for individually. If security is a concern, you can unzip the profile take out what you like, and then zip it up again. We may end up needing something you remove, but we can ask for that specifically.

You can also generate a profile manually using the script at /usr/local/nagiosxi/html/includes/components/profile/getprofile.sh

That should generate a profile in /usr/local/nagiosxi/var/components/ which you can get off the server with an application such as FileZilla.

After you PM the profile, please update this thread. Updating this thread is the only way for it to show back up on our dashboard.

If you get an error that PROFILE BUILD FAILED, please see https://support.nagios.com/kb/article.p ... ategory=44

[udaykumar]

Hello,

Actually all the services are flapping with all states and some are genuine alerts but I want to reduce flow of mails even for genuine them.

Here , I'm attaching you the profile of XI. we are using MySQL.

[dwhitfield]

Do you want warnings or just criticals? One way to potentially reduce notifications is to turn off warnings. Are you getting notifications for flapping? You could turn those off. You can do all of that at the host/service level if you want to apply it to many contacts.

Ultimately, a clear understanding of the notifications system will go a long way to getting the appropriate amount of notifications: https://assets.nagios.com/downloads/nag ... ios-XI.pdf

[udaykumar]

hi,

Can't we change the interval to trigger alerts at every 4 hrs, instead of frequent alerts.

[dwhitfield]

Yes, that should work, but you said you did that and it didn't work. Please take a look at https://assets.nagios.com/downloads/nag ... tabase.pdf. There aren't any db errors in the log, but not all types of errors get logged, so running the repair script is a good idea.

Also, I notice you have ServiceNow integration. Are the notifications coming from Service Now? You may need to change things in your Service Now configuration.

What's the output of ipcs -q?

[udaykumar]

HI ,


out put is [root@ACPHOFNAG01 ~]# ipcs -q

------ Message Queues --------
key msqid owner perms used-bytes messages

[dwhitfield]

That output doesn't make any sense based on your previous profile. Can you PM me a new profile? It's been over a week since the last profile, so a lot of things could have changed.

[udaykumar]

Hi,

Please find the profile pulled now and also out put of command.

[root@ACPHOFNAG01 ~]# ipcs -q

------ Message Queues --------
key msqid owner perms used-bytes messages
0x42010002 6750208 nagios 600 0 0

[kyang]

Thanks for the updated profile.

There aren't any db errors in the log, but not all types of errors get logged, so running the repair script is a good idea

Did you happen to run the db repair script as @dwhitfield suggested?
https://assets.nagios.com/downloads/nag ... 1517324465

Also, I notice you have ServiceNow integration. Are the notifications coming from Service Now? You may need to change things in your Service Now configuration

Also, could you please verify this? Are the notifications coming from ServiceNow?

Can't we change the interval to trigger alerts at every 4 hrs, instead of frequent alerts

According to what you said, have you tried changing anything recently?