Page 1 of 3
Event Log
Posted: Thu Mar 12, 2015 1:53 pm
by mgaribaldi
Hello,
I had a question regarding logging in Nagios. I have two instances Nagios 3.4.1 and Nagios 3.5.1.
My Nagios 3.4.1 instance shows logs for all messages (up, down, flapping, informational, etc), but my 3.5.1 does not log any informative events. It does not show a history of OK and UP logs for all my services and hosts. Alerts are logged, but if there are no alert notifications, all that is logged daily is the "Auto-save of retention data completed successfully." Please see pic below.
In my 3.5.1 instance, I have the following log statements below in my nagios.cfg file:
log_file=/var/log/nagios3/nagios.log
log_rotation_method=d
log_archive_path=/var/log/nagios3/archives
use_syslog=1
log_notifications=1
log_service_retries=1
log_host_retries=1
log_event_handlers=1
log_initial_states=0
log_external_commands=1
log_passive_checks=1
Is there something I am missing?
Thank you!
Re: Event Log
Posted: Thu Mar 12, 2015 2:12 pm
by jolson
First off - love the signature.
Secondly, can you check to ensure that those log files exist, and that they're logging properly?
Also, be sure to check the permissions and make sure that they are set to nagios:nagios 644
EDIT: cut out the second half of my post because I realized that you're on Nagios Core 3. Disregard below.
If the logs there seem fine, a good test would be to re-create your normal log file and set the Nagios Core Server to log there:
Code: Select all
touch /usr/local/nagios/var/nagios.log
chown nagios:nagios /usr/local/nagios/var/nagios.log
chmod 644 /usr/local/nagios/var/nagios.log
vi /usr/local/nagios/etc/nagios.cfg (change the log_file=/var/log/nagios3/nagios.log to /usr/local/nagios/var/nagios.log)
service nagios restart
service httpd restart
Do the logs show up in the webGUI at this point?[/s]
Re: Event Log
Posted: Thu Mar 12, 2015 3:33 pm
by mgaribaldi
Thank you for the quick response!
When I tail /var/log/nagios3/nagios.log I see the same logs, no more/less in the GUI.
Code: Select all
root@nagios1:/var/log/nagios3# tail /var/log/nagios3/nagios.log
[1426180595] Auto-save of retention data completed successfully.
[1426184195] Auto-save of retention data completed successfully.
[1426185014] Caught SIGTERM, shutting down...
[1426185014] Successfully shutdown... (PID=9770)
[1426185015] Nagios 3.5.1 starting... (PID=24450)
[1426185015] Local time is Thu Mar 12 11:30:15 PDT 2015
[1426185015] LOG VERSION: 2.0
[1426185015] Finished daemonizing... (New PID=24451)
[1426188615] Auto-save of retention data completed successfully.
root@nagios1:/var/log/nagios3#
The permissions are set correctly.
Code: Select all
root@nagios1:/var/log/nagios3# ls -lh
total 28K
drwxr-s--x 2 nagios adm 20K Mar 12 00:00 archives
-rw-r--r-- 1 nagios adm 4.5K Mar 12 12:30 nagios.log
Thanks again,
Michael
Re: Event Log
Posted: Thu Mar 12, 2015 3:44 pm
by jdalrymple
Can you enable initial states so that it's more clear when the problem is resolved.
Also, can we see the out put of
Code: Select all
/usr/bin/nagios -v /etc/nagios/nagios.cfg
The paths in the prior command will almost certainly need to be modified.
Re: Event Log
Posted: Thu Mar 12, 2015 4:14 pm
by mgaribaldi
Here is the output for /usr/sbin/nagios3 -v /etc/nagios3/nagios.cfg. The 1 warning I have is due to a single host that I do not have any service checks for at the moment (been like that for a long time actually).
I will set log_initial_states to 1.
Code: Select all
root@nagios1:/home/ubuntu# /usr/sbin/nagios3 -v /etc/nagios3/nagios.cfg
Nagios Core 3.5.1
Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 08-30-2013
License: GPL
Website: http://www.nagios.org
Reading configuration data...
Read main config file okay...
Processing object config file '/etc/nagios3/commands.cfg'...
Processing object config directory '/etc/nagios-plugins/config'...
Processing object config file '/etc/nagios-plugins/config/whois.cfg'...
Processing object config file '/etc/nagios-plugins/config/games.cfg'...
Processing object config file '/etc/nagios-plugins/config/ldap.cfg'...
Processing object config file '/etc/nagios-plugins/config/ftp.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_win.cfg'...
Processing object config file '/etc/nagios-plugins/config/radius.cfg'...
Processing object config file '/etc/nagios-plugins/config/telnet.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_int.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_vrrp.cfg'...
Processing object config file '/etc/nagios-plugins/config/ssh.cfg'...
Processing object config file '/etc/nagios-plugins/config/rbl.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp.cfg'...
Processing object config file '/etc/nagios-plugins/config/ssl_cert.cfg'...
Processing object config file '/etc/nagios-plugins/config/multi.cfg'...
Processing object config file '/etc/nagios-plugins/config/webinject.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_cpfw.cfg'...
Processing object config file '/etc/nagios-plugins/config/fping.cfg'...
Processing object config file '/etc/nagios-plugins/config/dummy.cfg'...
Processing object config file '/etc/nagios-plugins/config/mail.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_storage.cfg'...
Processing object config file '/etc/nagios-plugins/config/pgsql.cfg'...
Processing object config file '/etc/nagios-plugins/config/breeze.cfg'...
Processing object config file '/etc/nagios-plugins/config/check_nrpe.cfg'...
Processing object config file '/etc/nagios-plugins/config/rpc-nfs.cfg'...
Processing object config file '/etc/nagios-plugins/config/mongodb.cfg'...
Processing object config file '/etc/nagios-plugins/config/tcp_udp.cfg'...
Processing object config file '/etc/nagios-plugins/config/users.cfg'...
Processing object config file '/etc/nagios-plugins/config/mrtg.cfg'...
Processing object config file '/etc/nagios-plugins/config/lm_sensors.cfg'...
Processing object config file '/etc/nagios-plugins/config/disk.cfg'...
Processing object config file '/etc/nagios-plugins/config/cups.cfg'...
Processing object config file '/etc/nagios-plugins/config/news.cfg'...
Processing object config file '/etc/nagios-plugins/config/real.cfg'...
Processing object config file '/etc/nagios-plugins/config/apt.cfg'...
Processing object config file '/etc/nagios-plugins/config/haproxy.cfg'...
Processing object config file '/etc/nagios-plugins/config/dhcp.cfg'...
Processing object config file '/etc/nagios-plugins/config/multipath.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_time.cfg'...
Processing object config file '/etc/nagios-plugins/config/printer.cfg'...
Processing object config file '/etc/nagios-plugins/config/ping.cfg'...
Processing object config file '/etc/nagios-plugins/config/ipmi_sensor.cfg'...
Processing object config file '/etc/nagios-plugins/config/load.cfg'...
Processing object config file '/etc/nagios-plugins/config/httpd_status.cfg'...
Processing object config file '/etc/nagios-plugins/config/ntp.cfg'...
Processing object config file '/etc/nagios-plugins/config/netware.cfg'...
Processing object config file '/etc/nagios-plugins/config/mailq.cfg'...
Processing object config file '/etc/nagios-plugins/config/ifstatus.cfg'...
Processing object config file '/etc/nagios-plugins/config/memcached.cfg'...
Processing object config file '/etc/nagios-plugins/config/dns.cfg'...
Processing object config file '/etc/nagios-plugins/config/http.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_process.cfg'...
Processing object config file '/etc/nagios-plugins/config/hppjd.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_load.cfg'...
Processing object config file '/etc/nagios-plugins/config/mysql.cfg'...
Processing object config file '/etc/nagios-plugins/config/zone_auth.cfg'...
Processing object config file '/etc/nagios-plugins/config/ajp.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_mem.cfg'...
Processing object config file '/etc/nagios-plugins/config/email_delivery.cfg'...
Processing object config file '/etc/nagios-plugins/config/bgpstate.cfg'...
Processing object config file '/etc/nagios-plugins/config/snmp_env.cfg'...
Processing object config file '/etc/nagios-plugins/config/flexlm.cfg'...
Processing object config file '/etc/nagios-plugins/config/zone-rrsig.cfg'...
Processing object config file '/etc/nagios-plugins/config/disk-smb.cfg'...
Processing object config file '/etc/nagios-plugins/config/procs.cfg'...
Processing object config file '/etc/nagios-plugins/config/nt.cfg'...
Processing object config directory '/etc/nagios3/conf.d'...
Processing object config file '/etc/nagios3/conf.d/generic-host_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/services_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/timeperiods_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/myservices.cfg'...
Processing object config file '/etc/nagios3/conf.d/hostgroups_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/generic-service_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/localhost_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/contacts_nagios2.cfg'...
Processing object config file '/etc/nagios3/conf.d/myhosts.cfg'...
Processing object config file '/etc/nagios3/conf.d/extinfo_nagios2.cfg'...
Read object config files okay...
Running pre-flight check on configuration data...
Checking services...
Checked 12 services.
Checking hosts...
Warning: Host 'XXX' has no services associated with it!
Checked 7 hosts.
Checking host groups...
Checked 5 host groups.
Checking service groups...
Checked 0 service groups.
Checking contacts...
Checked 1 contacts.
Checking contact groups...
Checked 1 contact groups.
Checking service escalations...
Checked 0 service escalations.
Checking service dependencies...
Checked 0 service dependencies.
Checking host escalations...
Checked 0 host escalations.
Checking host dependencies...
Checked 0 host dependencies.
Checking commands...
Checked 206 commands.
Checking time periods...
Checked 4 time periods.
Checking for circular paths between hosts...
Checking for circular host and service dependencies...
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...
Total Warnings: 1
Total Errors: 0
Things look okay - No serious problems were detected during the pre-flight check
root@nagios1:/home/ubuntu#
Thank you,
Michael
Re: Event Log
Posted: Fri Mar 13, 2015 1:05 pm
by jdalrymple
If you restart Nagios now does it post initial states? Please do a restart then take a look at the logs. If there isn't too much sensitive data in them feel free to post the last 100 lines or so for us to review.
The assumption is that it won't, I'm just wondering if the problem is somehow the configs are causing alerts to not be processed or if there is something *broken* preventing the processing of alerts.
Re: Event Log
Posted: Wed Mar 18, 2015 12:18 pm
by mgaribaldi
Sorry for the delay.
If I restart Nagios, the initial states to show but the CURRENT logs only show at the beginning of the day both in the /var/log/nagios3/nagios.log and GUI.
I restarted Ngaios last week with the same results. I'm thinking it might be something to do with my checks, even though I get alerts and the alerts are logged correctly.
Code: Select all
[1426665418] Auto-save of retention data completed successfully.
[1426669018] Auto-save of retention data completed successfully.
[1426672618] Auto-save of retention data completed successfully.
[1426676218] Auto-save of retention data completed successfully.
[1426679818] Auto-save of retention data completed successfully.
[1426683418] Auto-save of retention data completed successfully.
[1426687018] Auto-save of retention data completed successfully.
[1426690618] Auto-save of retention data completed successfully.
[1426694218] Auto-save of retention data completed successfully.
[1426697818] Auto-save of retention data completed successfully.
[1426698760] Caught SIGTERM, shutting down...
[1426698760] Successfully shutdown... (PID=17313)
[1426698760] Nagios 3.5.1 starting... (PID=7911)
[1426698760] Local time is Wed Mar 18 10:12:40 PDT 2015
[1426698760] LOG VERSION: 2.0
[1426698760] Finished daemonizing... (New PID=7912)
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 12.57 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 6.89 ms
[1426698760] INITIAL HOST STATE: localhost;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.04 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 4.66 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 9.89 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.40 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.10 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 10.49 ms
[1426698760] INITIAL SERVICE STATE: comcast-core-1;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 6.98 ms
[1426698760] INITIAL SERVICE STATE: localhost;Current Load;OK;HARD;1;OK - load average: 0.00, 0.01, 0.05
[1426698760] INITIAL SERVICE STATE: localhost;Current Users;OK;HARD;1;USERS OK - 0 users currently logged in
[1426698760] INITIAL SERVICE STATE: localhost;Disk Space;OK;HARD;1;DISK OK
[1426698760] INITIAL SERVICE STATE: localhost;HTTP;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 11783 bytes in 0.001 second response time
[1426698760] INITIAL SERVICE STATE: localhost;HTTPS;CRITICAL;HARD;4;Connection refused
[1426698760] INITIAL SERVICE STATE: localhost;SSH;OK;HARD;1;SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2 (protocol 2.0)
[1426698760] INITIAL SERVICE STATE: localhost;Total Processes;OK;HARD;1;PROCS OK: 84 processes
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.46 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.68 ms
[1426698760] INITIAL SERVICE STATE: XXX;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 3.70 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 3.57 ms
root@nagios1:/home/ubuntu#
Re: Event Log
Posted: Wed Mar 18, 2015 12:36 pm
by mgaribaldi
As you originally requested, here are the last 100 lines.
Code: Select all
root@nagios1:/home/ubuntu# tail -100 /var/log/nagios3/nagios.log
[1426662000] LOG ROTATION: DAILY
[1426662000] LOG VERSION: 2.0
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 13.24 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 7.03 ms
[1426662000] CURRENT HOST STATE: localhost;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.04 ms
[1426662000] CURRENT HOST STATE: nag01.corp.49ers.com;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 4.36 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 9.78 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.11 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 3.40 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 10.49 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 7.30 ms
[1426662000] CURRENT SERVICE STATE: localhost;Current Load;OK;HARD;1;OK - load average: 0.00, 0.01, 0.05
[1426662000] CURRENT SERVICE STATE: localhost;Current Users;OK;HARD;1;USERS OK - 0 users currently logged in
[1426662000] CURRENT SERVICE STATE: localhost;Disk Space;OK;HARD;1;DISK OK
[1426662000] CURRENT SERVICE STATE: localhost;HTTP;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 11783 bytes in 0.001 second response time
[1426662000] CURRENT SERVICE STATE: localhost;HTTPS;CRITICAL;HARD;4;Connection refused
[1426662000] CURRENT SERVICE STATE: localhost;SSH;OK;HARD;1;SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2 (protocol 2.0)
[1426662000] CURRENT SERVICE STATE: localhost;Total Processes;OK;HARD;1;PROCS OK: 77 processes
[1426662000] CURRENT SERVICE STATE: nag01.corp.49ers.com;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.38 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.47 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 1.92 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 2.03 ms
[1426665418] Auto-save of retention data completed successfully.
[1426669018] Auto-save of retention data completed successfully.
[1426672618] Auto-save of retention data completed successfully.
[1426676218] Auto-save of retention data completed successfully.
[1426679818] Auto-save of retention data completed successfully.
[1426683418] Auto-save of retention data completed successfully.
[1426687018] Auto-save of retention data completed successfully.
[1426690618] Auto-save of retention data completed successfully.
[1426694218] Auto-save of retention data completed successfully.
[1426697818] Auto-save of retention data completed successfully.
[1426698760] Caught SIGTERM, shutting down...
[1426698760] Successfully shutdown... (PID=17313)
[1426698760] Nagios 3.5.1 starting... (PID=7911)
[1426698760] Local time is Wed Mar 18 10:12:40 PDT 2015
[1426698760] LOG VERSION: 2.0
[1426698760] Finished daemonizing... (New PID=7912)
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 12.57 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 6.89 ms
[1426698760] INITIAL HOST STATE: localhost;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.04 ms
[1426698760] INITIAL HOST STATE: nag01.corp.49ers.com;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 4.66 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 9.89 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.40 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.10 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 10.49 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 6.98 ms
[1426698760] INITIAL SERVICE STATE: localhost;Current Load;OK;HARD;1;OK - load average: 0.00, 0.01, 0.05
[1426698760] INITIAL SERVICE STATE: localhost;Current Users;OK;HARD;1;USERS OK - 0 users currently logged in
[1426698760] INITIAL SERVICE STATE: localhost;Disk Space;OK;HARD;1;DISK OK
[1426698760] INITIAL SERVICE STATE: localhost;HTTP;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 11783 bytes in 0.001 second response time
[1426698760] INITIAL SERVICE STATE: localhost;HTTPS;CRITICAL;HARD;4;Connection refused
[1426698760] INITIAL SERVICE STATE: localhost;SSH;OK;HARD;1;SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2 (protocol 2.0)
[1426698760] INITIAL SERVICE STATE: localhost;Total Processes;OK;HARD;1;PROCS OK: 84 processes
[1426698760] INITIAL SERVICE STATE: nag01.corp.49ers.com;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.46 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.68 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 3.70 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 3.57 ms
root@nagios1:/home/ubuntu#
root@nagios1:/home/ubuntu#
root@nagios1:/home/ubuntu#
root@nagios1:/home/ubuntu#
root@nagios1:/home/ubuntu# tail -100 /var/log/nagios3/nagios.log
[1426662000] LOG ROTATION: DAILY
[1426662000] LOG VERSION: 2.0
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 13.24 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 7.03 ms
[1426662000] CURRENT HOST STATE: localhost;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.04 ms
[1426662000] CURRENT HOST STATE: nag01.corp.49ers.com;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 4.36 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 9.78 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.11 ms
[1426662000] CURRENT HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 3.40 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 10.49 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 7.30 ms
[1426662000] CURRENT SERVICE STATE: localhost;Current Load;OK;HARD;1;OK - load average: 0.00, 0.01, 0.05
[1426662000] CURRENT SERVICE STATE: localhost;Current Users;OK;HARD;1;USERS OK - 0 users currently logged in
[1426662000] CURRENT SERVICE STATE: localhost;Disk Space;OK;HARD;1;DISK OK
[1426662000] CURRENT SERVICE STATE: localhost;HTTP;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 11783 bytes in 0.001 second response time
[1426662000] CURRENT SERVICE STATE: localhost;HTTPS;CRITICAL;HARD;4;Connection refused
[1426662000] CURRENT SERVICE STATE: localhost;SSH;OK;HARD;1;SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2 (protocol 2.0)
[1426662000] CURRENT SERVICE STATE: localhost;Total Processes;OK;HARD;1;PROCS OK: 77 processes
[1426662000] CURRENT SERVICE STATE: nag01.corp.49ers.com;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.38 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.47 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 1.92 ms
[1426662000] CURRENT SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 2.03 ms
[1426665418] Auto-save of retention data completed successfully.
[1426669018] Auto-save of retention data completed successfully.
[1426672618] Auto-save of retention data completed successfully.
[1426676218] Auto-save of retention data completed successfully.
[1426679818] Auto-save of retention data completed successfully.
[1426683418] Auto-save of retention data completed successfully.
[1426687018] Auto-save of retention data completed successfully.
[1426690618] Auto-save of retention data completed successfully.
[1426694218] Auto-save of retention data completed successfully.
[1426697818] Auto-save of retention data completed successfully.
[1426698760] Caught SIGTERM, shutting down...
[1426698760] Successfully shutdown... (PID=17313)
[1426698760] Nagios 3.5.1 starting... (PID=7911)
[1426698760] Local time is Wed Mar 18 10:12:40 PDT 2015
[1426698760] LOG VERSION: 2.0
[1426698760] Finished daemonizing... (New PID=7912)
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 12.57 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 6.89 ms
[1426698760] INITIAL HOST STATE: localhost;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.04 ms
[1426698760] INITIAL HOST STATE: nag01.corp.49ers.com;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 4.66 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 9.89 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.40 ms
[1426698760] INITIAL HOST STATE: XXX;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 2.10 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 10.49 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 6.98 ms
[1426698760] INITIAL SERVICE STATE: localhost;Current Load;OK;HARD;1;OK - load average: 0.00, 0.01, 0.05
[1426698760] INITIAL SERVICE STATE: localhost;Current Users;OK;HARD;1;USERS OK - 0 users currently logged in
[1426698760] INITIAL SERVICE STATE: localhost;Disk Space;OK;HARD;1;DISK OK
[1426698760] INITIAL SERVICE STATE: localhost;HTTP;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 11783 bytes in 0.001 second response time
[1426698760] INITIAL SERVICE STATE: localhost;HTTPS;CRITICAL;HARD;4;Connection refused
[1426698760] INITIAL SERVICE STATE: localhost;SSH;OK;HARD;1;SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2 (protocol 2.0)
[1426698760] INITIAL SERVICE STATE: localhost;Total Processes;OK;HARD;1;PROCS OK: 84 processes
[1426698760] INITIAL SERVICE STATE: nag01.corp.49ers.com;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.46 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 4.68 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 3.70 ms
[1426698760] INITIAL SERVICE STATE: XXX;check_ping;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 3.57 ms
root@nagios1:/home/ubuntu#
Re: Event Log
Posted: Wed Mar 18, 2015 4:21 pm
by tgriep
On your 3.5.1 server, can you find when either a host or service had a hard state change and see if it shows up in the event log at that time?
Can you provide a screenshot of that?
Re: Event Log
Posted: Wed Mar 18, 2015 6:10 pm
by mgaribaldi
Thank you for your responses and your help.
Here is the information you requested. I have the GUI and respectable log for the same events.
Code: Select all
root@nagios1:/etc/nagios3/conf.d# tail -f /var/log/nagios3/nagios.log
[1426714988] Auto-save of retention data completed successfully.
[1426717148] SERVICE ALERT: XXX;check_ping;CRITICAL;SOFT;1;PING CRITICAL - Packet loss = 100%
[1426717168] HOST ALERT: XXX;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
[1426717208] SERVICE ALERT: XXX;check_ping;CRITICAL;HARD;2;PING CRITICAL - Packet loss = 100%
[1426717238] HOST ALERT: XXX;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
[1426717318] HOST ALERT: XXX;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
[1426717388] HOST ALERT: XXX;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
[1426717468] HOST ALERT: XXX;DOWN;SOFT;5;PING CRITICAL - Packet loss = 100%
[1426717538] HOST ALERT: XXX;DOWN;SOFT;6;PING CRITICAL - Packet loss = 100%
[1426717608] HOST ALERT: XXX;DOWN;SOFT;7;PING CRITICAL - Packet loss = 100%
[1426717678] HOST ALERT: XXX;DOWN;SOFT;8;PING CRITICAL - Packet loss = 100%
[1426717748] HOST ALERT: XXX;DOWN;SOFT;9;PING CRITICAL - Packet loss = 100%
[1426717818] HOST ALERT: XXX;DOWN;HARD;10;PING CRITICAL - Packet loss = 100%
[1426717818] HOST NOTIFICATION: mgaribaldi;XXX;DOWN;notify-host-by-email;PING CRITICAL - Packet loss = 100%
[1426718588] Auto-save of retention data completed successfully.