Page 1 of 2
Notification History Issue
Posted: Sun Jul 24, 2016 10:45 pm
by rajasegar
I have a service where the notifications is being sent out successfully but the history does not show anything.
Only difference compared to rest is the flapping check is disabled.
Details in my signature.
Code: Select all
define service {
host_name NET_INTERNET_BNG_EBB1,NET_INTERNET_BNG_EBB2
service_description BWC - Incoming Min Check
use STPT-ROUTER-BW-INTERNET
check_command rs_clicks_ebb_alert!$HOSTNAME$!$HOSTADDRESS$!20!20!!!!
max_check_attempts 5
check_interval 2
retry_interval 1
flap_detection_enabled 0
notification_period NET_EBB_BANGI_CHECK
contacts +infra_support
_critical_rec_sms true
_critical_sms true
register 1
}
2016-07-25_11-37-17.jpg
2016-07-25_11-36-40.jpg
Re: Notification History Issue
Posted: Sun Jul 24, 2016 11:01 pm
by Box293
Are you seeing anything logged in /var/log/httpd/error_log when you try running the history report?
Does anything appear if you change it to a bigger period like "This Week" ?
Re: Notification History Issue
Posted: Mon Jul 25, 2016 3:43 am
by rajasegar
Box293 wrote:Are you seeing anything logged in /var/log/httpd/error_log when you try running the history report?
Does anything appear if you change it to a bigger period like "This Week" ?
Nothing comes out even if I select this whole year.
No alerts when running history report. I did notice only host alerts showing up for "This month".
Re: Notification History Issue
Posted: Mon Jul 25, 2016 11:36 am
by tgriep
In the Nagios XI GUI, can you go to the Admin > Performance Settings menu, click on the Databases tab and verify that the Max Notification Age is set to how you want?
By default, it should be set to 90 days.
Can you open the Event Log from the Home screen and do you see the Host or Service Notification entry there?
Re: Notification History Issue
Posted: Mon Jul 25, 2016 8:15 pm
by rajasegar
tgriep wrote:In the Nagios XI GUI, can you go to the Admin > Performance Settings menu, click on the Databases tab and verify that the Max Notification Age is set to how you want?
By default, it should be set to 90 days.
Can you open the Event Log from the Home screen and do you see the Host or Service Notification entry there?
Everything is fine except for this service. There is no notification history even though notifications is working fine.
The rest of the services is ok.
Re: Notification History Issue
Posted: Tue Jul 26, 2016 9:08 am
by tgriep
So this one service has no information in the Notifications report and no information in the Event Log?
Can you post the configuration file for that service so we can view it?
Also login as root to the XI server, run the following command and post the output.
Code: Select all
grep NET_INTERNET_BNG_EBB2 /usr/local/nagios/var/archives/*
Re: Notification History Issue
Posted: Tue Jul 26, 2016 7:37 pm
by rajasegar
tgriep wrote:So this one service has no information in the Notifications report and no information in the Event Log?
Can you post the configuration file for that service so we can view it?
Also login as root to the XI server, run the following command and post the output.
Code: Select all
grep NET_INTERNET_BNG_EBB2 /usr/local/nagios/var/archives/*
Definition for service is in the first post.
There is event log just no notification history.
Code: Select all
Lots of line in the output starting from 07-24-2-16
grep NET_INTERNET_BNG_EBB2 /usr/local/nagios/var/archives/*
.... snipped
/usr/local/nagios/var/archives/nagios-07-27-2016-00.log:[1469462740] SERVICE ALERT: NET_INTERNET_BNG_EBB2;BWC - Incoming Min Check;CRITICAL;HARD;5;CRITICAL - NET_INTERNET_BNG_EBB2 incoming BW is 10Mbps, outgoing is 1Mbps (20/20)
/usr/local/nagios/var/archives/nagios-07-27-2016-00.log:[1469487960] SERVICE ALERT: NET_INTERNET_BNG_EBB2;BWC - Incoming Min Check;OK;HARD;5;OK - NET_INTERNET_BNG_EBB2 incoming BW is 20Mbps, outgoing is 5Mbps (20/20)
/usr/local/nagios/var/archives/nagios-07-27-2016-00.log:[1469488190] SERVICE ALERT: NET_INTERNET_BNG_EBB2;BWC - Incoming Min Check;CRITICAL;SOFT;1;CRITICAL - NET_INTERNET_BNG_EBB2 incoming BW is 18Mbps, outgoing is 4Mbps (20/20)
/usr/local/nagios/var/archives/nagios-07-27-2016-00.log:[1469488250] SERVICE ALERT: NET_INTERNET_BNG_EBB2;BWC - Incoming Min Check;CRITICAL;SOFT;2;CRITICAL - NET_INTERNET_BNG_EBB2 incoming BW is 18Mbps, outgoing is 4Mbps (20/20)
/usr/local/nagios/var/archives/nagios-07-27-2016-00.log:[1469488310] SERVICE ALERT: NET_INTERNET_BNG_EBB2;BWC - Incoming Min Check;CRITICAL;SOFT;3;CRITICAL - NET_INTERNET_BNG_EBB2 incoming BW is 18Mbps, outgoing is 4Mbps (20/20)
/usr/local/nagios/var/archives/nagios-07-27-2016-00.log:[1469488370] SERVICE ALERT: NET_INTERNET_BNG_EBB2;BWC - Incoming Min Check;OK;SOFT;4;OK - NET_INTERNET_BNG_EBB2 incoming BW is 22Mbps, outgoing is 5Mbps (20/20)
Re: Notification History Issue
Posted: Wed Jul 27, 2016 9:30 am
by tgriep
Sorry about that, I meant posting the service template.
The service config you have posted, doesn't show that the notifications are enabled so we need to verify that the template has it enabled.
From the output of the grep, I don't see the notification message so it may need to be enabled.
Re: Notification History Issue
Posted: Wed Jul 27, 2016 8:00 pm
by rajasegar
tgriep wrote:Sorry about that, I meant posting the service template.
The service config you have posted, doesn't show that the notifications are enabled so we need to verify that the template has it enabled.
From the output of the grep, I don't see the notification message so it may need to be enabled.
Notifications are being sent out, only missing in notification history.
Code: Select all
define service {
name STPT-ROUTER-BW-INTERNET
service_description STPT-ROUTER-BW-INTERNET
use STPT-0-generic-service
max_check_attempts 5
check_interval 4
retry_interval 1
contact_groups +CGRP_INFRA_NETWORK
register 0
}
Re: Notification History Issue
Posted: Thu Jul 28, 2016 9:21 am
by tgriep
Maybe it is a corrupt MYSQL entry causing it.
Do you see any errors in the /var/log/mysqld.log file?
Can you create a new copy of that check and see if that works for you?
Also, run the following as root on the server and post the output here.