Page 1 of 3
After 2014 upgrade, host notifications disabled
Posted: Tue May 20, 2014 3:24 pm
by SavaSC
Just updated to XI 2014. After logging in I noticed that "Open Service Problems" was empty. (There were about 9 or so before I updated.) I checked All Service Problems and there they were. On that Service Status page, all of the hosts listed with service problems are showing as Notifications are Disabled, however, if I click on the link to the host, it is not disabled in that view. If I go to Host Detail, none of the hosts are listed with Disabled Notifications. This seems to be showing only in the All Service Problems area. When a new service error shows up, the host is marked as Notifications Disabled even though we've not touched it.
*Note* The services with errors aren't marked as disabled notifications, but rather the hosts themselves.
How can I get these hosts back to normal and to show up under "Open Service Problems"?
Thank you!
Re: After 2014 upgrade, host notifications disabled
Posted: Wed May 21, 2014 8:16 am
by SavaSC
Here is the profile file downloaded from Admin -> System Profile.
Re: After 2014 upgrade, host notifications disabled
Posted: Wed May 21, 2014 1:03 pm
by slansing
Your update may not have completed properly, what is the output of:
Code: Select all
/usr/local/nagios/bin/nagios | head -2
/usr/local/nagios/bin/ndo2db | head -2
service ndo2db stop
service nagios stop
service nagios start
service ndo2db start
tail -30 /usr/local/nagios/var/nagios.log
tail -30 /var/log/messages
Please run the above in that order.
Re: After 2014 upgrade, host notifications disabled
Posted: Wed May 21, 2014 1:27 pm
by SavaSC
I get a screen full of of the following lines:
140521 13:24:01 [ERROR] /usr/libexec/mysqld: Table './nagios/nagios_logentries' is marked as crashed and last (automatic?) repair failed
Re: After 2014 upgrade, host notifications disabled
Posted: Wed May 21, 2014 1:37 pm
by lmiltchev
Run the following commands:
Code: Select all
cd /usr/local/nagiosxi/scripts
./repairmysql.sh nagios
./repairmysql.sh nagiosql
then run:
and show us the output.
When you go to: Admin->System Profile, what is the number of hosts/services that you see?
Run the following commands and show us the output:
Code: Select all
/usr/local/nagios/bin/nagios | head -2
/usr/local/nagios/bin/ndo2db | head -2
Re: After 2014 upgrade, host notifications disabled
Posted: Fri May 23, 2014 12:45 pm
by SavaSC
Sorry it took me so long to respond. I was not in the office yesterday.
The output for the mysqld.log is:
Code: Select all
140523 12:36:36 InnoDB: Shutdown completed; log sequence number 0 43655
140523 12:36:36 [Note] /usr/libexec/mysqld: Shutdown complete
140523 12:36:36 mysqld ended
140523 12:37:22 mysqld started
140523 12:37:22 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:22 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:23 InnoDB: Started; log sequence number 0 43655
140523 12:37:23 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution
140523 12:37:50 [Note] /usr/libexec/mysqld: Normal shutdown
140523 12:37:52 InnoDB: Starting shutdown...
140523 12:37:53 InnoDB: Shutdown completed; log sequence number 0 43655
140523 12:37:53 [Note] /usr/libexec/mysqld: Shutdown complete
140523 12:37:53 mysqld ended
140523 12:37:53 mysqld started
140523 12:37:53 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:53 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:53 InnoDB: Started; log sequence number 0 43655
140523 12:37:53 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution
Here is the rest of the output you requested.
Code: Select all
/usr/local/nagios/bin/nagios | head -2
Nagios Core 4.0.5
Code: Select all
/usr/local/nagios/bin/ndo2db | head -2
NDO2DB 2.0.0
And here is the info from Nagios
Code: Select all
Nagios XI Installation Profile
Download Profile
System:
Nagios XI Version : 2014R1.0
ltc099l 2.6.18-164.9.1.el5 i686
CentOS release 5.4 (Final)
Gnome is not installed
Apache Information
PHP Version: 5.1.6
Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0
Server Name: hou-nagiosxi
Server Address: 10.90.18.24
Server Port: 80
Date/Time
PHP Timezone: America/Chicago
PHP Time: Fri, 23 May 2014 12:40:17 -0500
System Time: Fri, 23 May 2014 12:40:17 -0500
Nagios XI Data
License ends in: TOPQPN
nagios (pid 2254) is running...
NPCD running (pid 3789).
ndo2db (pid 2345) is running...
CPU Load 15: 0.31
Total Hosts: 0
Total Services: 0
Function 'get_base_uri' returns: http://hou-nagiosxi/nagiosxi/
Function 'get_base_url' returns: http://hou-nagiosxi/nagiosxi/
Function 'get_backend_url(internal_call=false)' returns: http://hou-nagiosxi/nagiosxi/includes/components/profile/profile.php
Function 'get_backend_url(internal_call=true)' returns: http://localhost/nagiosxi/backend/
Re: After 2014 upgrade, host notifications disabled
Posted: Fri May 23, 2014 12:55 pm
by scottwilkerson
Did you run the following commands like lmiltchev asked?:
Code: Select all
cd /usr/local/nagiosxi/scripts
./repairmysql.sh nagios
./repairmysql.sh nagiosql
Re: After 2014 upgrade, host notifications disabled
Posted: Fri May 23, 2014 1:12 pm
by SavaSC
Yes, I did.
Re: After 2014 upgrade, host notifications disabled
Posted: Fri May 23, 2014 1:51 pm
by lmiltchev
Your mysql database is not offloaded to a remote server, is it? Where did you run the repair script? Can you restart mysqld again and show the log?
Code: Select all
service mysqld restart
tail -25 /var/log/mysqld.log
You still have "0" hosts and services in the profile...
Total Hosts: 0
Total Services: 0
Re: After 2014 upgrade, host notifications disabled
Posted: Tue May 27, 2014 8:29 am
by SavaSC
To the best of my knowledge the MySQL instance is running on the same box as this Nagios instance. I just inherited the program, I didn't build it. I have looked through the documentation we have and nothing indicates there is any outside database.
I stopped and started the msqld service and here is an output of the log.
Code: Select all
140523 14:41:57 InnoDB: Shutdown completed; log sequence number 0 43655
140523 14:41:57 [Note] /usr/libexec/mysqld: Shutdown complete
140523 14:41:57 mysqld ended
140523 14:41:58 mysqld started
140523 14:41:58 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 14:41:58 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 14:41:58 InnoDB: Started; log sequence number 0 43655
140523 14:41:58 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution
140527 8:12:37 [Note] /usr/libexec/mysqld: Normal shutdown
140527 8:12:39 InnoDB: Starting shutdown...
140527 8:12:40 InnoDB: Shutdown completed; log sequence number 0 43655
140527 8:12:40 [Note] /usr/libexec/mysqld: Shutdown complete
140527 08:12:40 mysqld ended
140527 08:12:41 mysqld started
140527 8:12:41 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140527 8:12:41 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140527 8:12:41 InnoDB: Started; log sequence number 0 43655
140527 8:12:41 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution
I am not sure why it says zero hosts and services. There are over a hundred hosts with their respective services being monitored from this instance of NagiosXI.
Thanks for all the help so far.