recovery without critical

[Maxwellb99]

Hello,

I'd like to discuss how checks are executed.
to motivate this, we received a return-to-normal without a critical state change, further, after looking at the data I think we should have received a critical state change.

I have check_interval=1;retry_interval=1;max_check_attempts=2;critical=1

cap_ave_time_on_battery_object.PNG

when I hover over the points they read:5:27=0; 5:28>0; 5:29>0; 5:30=0. My understanding is that it should have gone soft down 5:28. Hard Down 5:29. RTN 5:30

cap-ups-annex-time_on_battery.png

According to the docs it went soft down 5:29, hard down 5:30.

state_history.PNG

Apparently the max attachments is 3. Anyway - The crux of this whole thing. Nagios sent out Service Recovery emails; without critical emails. According to state history this thing never went hard down to send out a service critical email. Please advise.

[lmiltchev]

What is the Nagios XI and Nagios Core version that you are currently using?

Was the host in a down state when this was happening? The bug should be fixed in Nagios Core 4.4.3 - check this out:

https://github.com/NagiosEnterprises/na ... issues/572

[Maxwellb99]

Nagios XI - System Info
System
Nagios XI version: 5.5.9
Release info: *** 3.10.0-693.el7.x86_64 x86_64
CentOS Linux release 7.4.1708 (Core)
Gnome is not installed
Apache Information
PHP Version: 5.4.16
Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.109 Safari/537.36
Server Name: ***
Server Address: ***
Server Port: 443
Date/Time
PHP Timezone: US/Eastern
PHP Time: Thu, 21 Feb 2019 14:24:32 -0500
System Time: Thu, 21 Feb 2019 14:24:32 -0500
Nagios XI Data
License ends in: ****
UUID: ***
Install Type: source

Nagios XI Components
actions 2.0.1
alertcloud 1.2.1
alertstream 2.1.0
autodiscovery 2.2.6
backendapiurl 1.0.3
bandwidthreport 1.8.0
bbmap 1.2.0
birdseye 3.2.2
bulkmodifications 2.2.0
capacityplanning 2.3.0
ccm 2.7.3
custom-includes 1.0.4
customlogin 1.0.0
customlogo 1.2.0
deploydashboard 1.3.0
deploynotification 1.3.3
duo 1.0.0
escalationwizard 1.5.0
freevariabletab 1.0.1
globaleventhandler 1.2.2
graphexplorer 2.2.1
helpsystem 2.0.0
highcharts 4.0.1
homepagemod 1.1.7
hypermap 1.1.6
hypermap_replay 1.2.0
isms 1.2.3
latestalerts 1.2.6
ldap_ad_integration 1.1.0
massacknowledge 2.1.14
metrics 1.2.10
minemap 1.2.4
nagiosbpi 2.7.3
nagioscore
nagioscorecfg
nagiosim 2.2.6
nagiosna 1.4.0
nagiosql
nagvis 2.0.0
nocscreen 1.1.2
nrdsconfigmanager 1.6.4
nxti 1.0.2
opscreen 1.8.0
perfdata
pingaction 1.1.1
pnp
profile 1.4.0
proxy 1.1.4
rdp 1.0.3
rename 1.6.0
scheduledbackups 1.2.0
scheduledreporting
similetimeline 1.5.0
snmptrapsender 1.5.5
statusmap 1.0.2
tracerouteaction 1.1.1
usermacros 1.1.0
xicore
Nagios XI Config Wizards
ec2 1.0.0
s3 1.0.0
autodiscovery 1.4.1
bpiwizard 1.1.4
bulkhostimport 2.0.4
digitalocean 1.0.0
google-cloud 1.0.0
linode 1.0.0
microsoft-azure 1.0.0
rackspace 1.0.0
dhcp 1.1.4
dnsquery 1.1.3
docker 1.0.0
domain_expiration 1.1.4
email-delivery 2.0.4
esensors_websensor 1.1.4
exchange 1.3.2
folder_watch 1.0.5
ftpserver 1.5.5
genericnetdevice 1.0.3
ldapserver 1.3.3
linux-server 1.5.5
linux_snmp 1.5.4
macosx 1.3.0
mailserver 1.2.4
mongodb_database 1.1.2
mongodbserver 1.1.2
mountpoint 1.0.2
mssql_database 1.6.2
mssql_query 1.6.4
mssql_server 1.9.1
mysqlquery 1.2.3
mysqlserver 1.3.3
nagioslogserver 1.0.5
nagiostats 1.2.3
nagiosxiserver 1.3.0
ncpa 2.0.0
nna 1.0.4
nrpe 1.5.2
oraclequery 1.3.3
oracleserverspace 1.5.3
oracletablespace 1.5.4
passivecheck 1.2.4
passiveobject 1.1.3
postgresdb 1.5.3
postgresquery 1.2.3
postgresserver 1.3.4
printer 1.1.3
radiusserver 2.0.1
sla 1.3.2
snmp 1.5.8
snmp_trap 1.5.3
snmpwalk 1.3.6
solaris 1.2.5
sshproxy 1.5.7
switch 2.4.0
tcpudpport 1.3.3
tftp 1.0.2
vmware 1.7.1
watchguard 1.4.5
website 1.3.0
website_defacement 1.1.5
websiteurl 1.3.7
webtransaction 1.2.5
windowseventlog 1.3.3
windowsserver 1.6.1
windowsdesktop 1.6.1
windowssnmp 1.5.1
windowswmi 2.1.0
Nagios XI Dashlets
alertcloud
bbmap
capacityplanning
graphexplorer
hypermap
latestalerts
metrics
metricsguage
minemap
xicore_xi_news_feed
xicore_getting_started
xicore_admin_tasks
xicore_eventqueue_chart
xicore_component_status
xicore_server_stats
xicore_monitoring_stats
xicore_monitoring_perf
xicore_monitoring_process
xicore_perfdata_chart
xicore_host_status_summary
xicore_service_status_summary
xicore_comments
xicore_hostgroup_status_overview
xicore_hostgroup_status_grid
xicore_servicegroup_status_overview
xicore_servicegroup_status_grid
xicore_hostgroup_status_summary
xicore_servicegroup_status_summary
xicore_available_updates
xicore_network_outages
xicore_network_outages_summary
xicore_network_health
xicore_host_status_tac_summary
xicore_service_status_tac_summary
xicore_feature_status_tac_summary
availability
custom_dashlet 1.0.5
gauges 1.2.2
googlemapdashlet 1.1.0
internettrafficreport
rss_dashlet 1.1.3
sansrisingports 2.0
sla
worldtimeserver 2.0.0

[npolovenko]

Hello, @Maxwellb99.

According to the docs it went soft down 5:29, hard down 5:30.

Both critical states are soft on the screenshot.
Could you attach a screenshot of the notification report for this service for the same time period? Maybe from 05:00 to 06:00.

Also, please run the following commands and show me the output:

/usr/local/nagios/bin/nagios | grep "Nagios Core"

ps -ef | grep nagios.cfg

[Maxwellb99]

[****@****~]$ sudo /usr/local/nagios/bin/nagios |grep "Nagios Core"
Nagios Core 4.4.3
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
[****@**** ~]$ ps -ef |grep nagios.cfg
**** 970 31567 0 15:35 pts/0 00:00:00 grep --color=auto nagios.cfg
nagios 25660 1 0 10:57 ? 00:01:56 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg
nagios 25779 25660 0 10:57 ? 00:00:00 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg

notification_history.PNG

[npolovenko]

@Maxwellb99, At first glance, this looks like a bug. Can you send me the host state report for the same time period? cap-ups-annex

Could you send in your Nagios XI System Profile so I can review it?

To send us your system profile. Login to the Nagios XI GUI using a web browser.
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and send it to me in a private message.

[Maxwellb99]

Please forgive my ignorance. Is the " host state report" different than the "Host state history?"

This should be the same as the one given above. Full profile.zip sent by pm.

state_history.PNG

Thanks.

[ssax]

I think he just meant run the same report but do it for just the host now.

Or you can:

Run the same report (Reports > State History):
- Limit it only to the host, don't limit to the service
- Choose Type: Both, State Type: Both, State: Any
- For the Period choose a little before and a little after the time that these occurred, that way we can see what state the host was in, what state the service was in, and also include soft states.

Thanks

[Maxwellb99]

Hi Guys,

Sorry I was PTO Friday. After following the directions, this is what I get. Please let me know if you need anything else.

cap-ups-annex.JPG

[ssax]

Hmm, that doesn't really show us much but it still looks like a bug, what's also strange is that your OK state is showing HARD 2 of 2, almost like the counter didn't get reset, it should have.

Based on the information shown the recovery *should* have been a SOFT recovery and no notifications should have been sent and the logic is supposed to be if you didn't receive the problem notification that you shouldn't receive a recovery.