Notification sent out for contact groups but not for contact

[gregwhite]

Our Citrix servers are put in scheduled downtime on Saturday and Sunday from 3am to 6am while they are rebooted. On the weekend of March 16th and 23rd, when these systems came out of downtime, the ones that were still down sent notification to 2 contact groups and a single contact. This past weekend, when the servers came out of downtime, those that were still down notifications went out to the 2 contact groups but no notification went out for the contact.

Thanks,
Greg

[npolovenko]

Hello, @gregwhite. Could you upload pdf reports(state history and notification report) for the servers that went down, for the March 16th and 23rd? That way we can compare them and see if there were any differences between how they went into critical states&downtime.
What version of XI are you running?

[gregwhite]

I have uploaded 2 notification files and 2 state history files. They show one of the devices that did not send a notification to the contact. The notification file with extension 324 is the one that worked and the file with 331 didn't. It sent out email to the notification groups but the contact - DL-Atrius_Citrix_level1 didn't. When you look at notifications for 324 you will see DL-Atrius_Citrix_level1. Also there are two state history reports 324 and 331.
We are running Nagios 5.4.12

Thanks,
Greg

[ssax]

Please PM me a copy of your profile as well, you can download it from Admin > System Profile > Download Profile.

[ssax]

Looks like your timeperiod doesn't have anything defined for that contact:

Code: Select all

define timeperiod {
	timeperiod_name	DL-Atrius_Citrix_level1_notification_times
	alias	Notification Times for DL-Atrius_Citrix_level1
	}

Please run these commands and see if the issue is now resolved:

Please go to Configure > Core Config Manager > Tools > Config File Management:
- Click the Delete Files button (don't worry, it's safe, they will be rewritten)
- Then click the Write Configs button
- Once the files are done being written, (don't apply config), look at this file and see if the timeperiod still is empty:

Code: Select all

/usr/local/nagios/etc/timeperiods.cfg

If it IS still empty, run these commands (as root) and it should resolve the issue:

Code: Select all

cat << EOF > /usr/local/nagios/etc/import/timeperiods.cfg
define timeperiod {
    timeperiod_name  DL-Atrius_Citrix_level1_notification_times
    alias            Notification Times for DL-Atrius_Citrix_level1
    saturday         00:00-24:00
    friday           00:00-24:00
    thursday         00:00-24:00
    wednesday        00:00-24:00
    tuesday          00:00-24:00
    monday           00:00-24:00
    sunday           00:00-24:00
}
EOF
/usr/local/nagiosxi/scripts/reconfigure_nagios.sh

Let us know the results.

[gregwhite]

Great!!! We have the timeperiods added back in. Any thoughts what may have caused them to disappear? They must have been there the prior two weeks because notifications did go out. They were the only group that were affected.

Thanks,
Greg

[ssax]

It was only that single timeperiod so it was likely modified by someone, you could check CCM > CCM Admin > Audit log to see if it's listed.

[gregwhite]

Thanks. CCM audit log only had today's events so I looked at NagiosXI audit log. I did see where someone did delete a couple of time periods. But the log doesn't say which one got deleted. I know he was in there doing some cleanup of old accounts. It would be nice to have the audit log contain more detail.
It makes sense though that was probably what happened.
Thanks for your help and the resolution!!
Greg

[lmiltchev]

It would be nice to have the audit log contain more detail.

Just to give you the heads up - the audit log in Nagios XI 5.6.0 will contain a lot more detailed information, practically about all actions performed under the CCM.

Thanks for your help and the resolution!!

I am glad your issue has been resolved! Let us know if it is OK to close this topic. Thank you!