After 2014 upgrade, host notifications disabled

[SavaSC]

Just updated to XI 2014. After logging in I noticed that "Open Service Problems" was empty. (There were about 9 or so before I updated.) I checked All Service Problems and there they were. On that Service Status page, all of the hosts listed with service problems are showing as Notifications are Disabled, however, if I click on the link to the host, it is not disabled in that view. If I go to Host Detail, none of the hosts are listed with Disabled Notifications. This seems to be showing only in the All Service Problems area. When a new service error shows up, the host is marked as Notifications Disabled even though we've not touched it.

*Note* The services with errors aren't marked as disabled notifications, but rather the hosts themselves.

How can I get these hosts back to normal and to show up under "Open Service Problems"?

Thank you!

[SavaSC]

Here is the profile file downloaded from Admin -> System Profile.

[slansing]

Your update may not have completed properly, what is the output of:

Code: Select all

/usr/local/nagios/bin/nagios | head -2

/usr/local/nagios/bin/ndo2db | head -2

service ndo2db stop

service nagios stop

service nagios start

service ndo2db start

tail -30 /usr/local/nagios/var/nagios.log
tail -30 /var/log/messages 

Code: Select all

tail -30 /var/log/mysqld.log

Please run the above in that order.

[SavaSC]

I get a screen full of of the following lines:

140521 13:24:01 [ERROR] /usr/libexec/mysqld: Table './nagios/nagios_logentries' is marked as crashed and last (automatic?) repair failed

[lmiltchev]

Run the following commands:

Code: Select all

cd /usr/local/nagiosxi/scripts
./repairmysql.sh nagios
./repairmysql.sh nagiosql

then run:

Code: Select all

tail -25 /var/log/mysqld.log

and show us the output.

When you go to: Admin->System Profile, what is the number of hosts/services that you see?

Run the following commands and show us the output:

Code: Select all

/usr/local/nagios/bin/nagios | head -2
/usr/local/nagios/bin/ndo2db | head -2

[SavaSC]

Sorry it took me so long to respond. I was not in the office yesterday.

The output for the mysqld.log is:

Code: Select all

140523 12:36:36  InnoDB: Shutdown completed; log sequence number 0 43655
140523 12:36:36 [Note] /usr/libexec/mysqld: Shutdown complete

140523 12:36:36  mysqld ended

140523 12:37:22  mysqld started
140523 12:37:22 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:22 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:23  InnoDB: Started; log sequence number 0 43655
140523 12:37:23 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  Source distribution
140523 12:37:50 [Note] /usr/libexec/mysqld: Normal shutdown

140523 12:37:52  InnoDB: Starting shutdown...
140523 12:37:53  InnoDB: Shutdown completed; log sequence number 0 43655
140523 12:37:53 [Note] /usr/libexec/mysqld: Shutdown complete

140523 12:37:53  mysqld ended

140523 12:37:53  mysqld started
140523 12:37:53 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:53 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 12:37:53  InnoDB: Started; log sequence number 0 43655
140523 12:37:53 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  Source distribution

Here is the rest of the output you requested.

Code: Select all

 /usr/local/nagios/bin/nagios | head -2

Nagios Core 4.0.5

Code: Select all

 /usr/local/nagios/bin/ndo2db | head -2

NDO2DB 2.0.0

And here is the info from Nagios

Code: Select all

Nagios XI Installation Profile
Download Profile	
System:
Nagios XI Version : 2014R1.0
ltc099l 2.6.18-164.9.1.el5 i686
CentOS release 5.4 (Final)
Gnome is not installed
Apache Information
PHP Version: 5.1.6
Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0
Server Name: hou-nagiosxi
Server Address: 10.90.18.24
Server Port: 80
Date/Time
PHP Timezone: America/Chicago
PHP Time: Fri, 23 May 2014 12:40:17 -0500
System Time: Fri, 23 May 2014 12:40:17 -0500
Nagios XI Data
License ends in: TOPQPN

nagios (pid 2254) is running...
NPCD running (pid 3789).
ndo2db (pid 2345) is running...
CPU Load 15: 0.31
Total Hosts: 0
Total Services: 0
Function 'get_base_uri' returns: http://hou-nagiosxi/nagiosxi/
Function 'get_base_url' returns: http://hou-nagiosxi/nagiosxi/
Function 'get_backend_url(internal_call=false)' returns: http://hou-nagiosxi/nagiosxi/includes/components/profile/profile.php
Function 'get_backend_url(internal_call=true)' returns: http://localhost/nagiosxi/backend/

[scottwilkerson]

Did you run the following commands like lmiltchev asked?:

Code: Select all

cd /usr/local/nagiosxi/scripts
./repairmysql.sh nagios
./repairmysql.sh nagiosql

[SavaSC]

Yes, I did.

[lmiltchev]

Your mysql database is not offloaded to a remote server, is it? Where did you run the repair script? Can you restart mysqld again and show the log?

Code: Select all

service mysqld restart
tail -25 /var/log/mysqld.log

You still have "0" hosts and services in the profile...

Total Hosts: 0
Total Services: 0

[SavaSC]

To the best of my knowledge the MySQL instance is running on the same box as this Nagios instance. I just inherited the program, I didn't build it. I have looked through the documentation we have and nothing indicates there is any outside database.

I stopped and started the msqld service and here is an output of the log.

Code: Select all

140523 14:41:57  InnoDB: Shutdown completed; log sequence number 0 43655
140523 14:41:57 [Note] /usr/libexec/mysqld: Shutdown complete

140523 14:41:57  mysqld ended

140523 14:41:58  mysqld started
140523 14:41:58 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 14:41:58 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140523 14:41:58  InnoDB: Started; log sequence number 0 43655
140523 14:41:58 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  Source distribution
140527  8:12:37 [Note] /usr/libexec/mysqld: Normal shutdown

140527  8:12:39  InnoDB: Starting shutdown...
140527  8:12:40  InnoDB: Shutdown completed; log sequence number 0 43655
140527  8:12:40 [Note] /usr/libexec/mysqld: Shutdown complete

140527 08:12:40  mysqld ended

140527 08:12:41  mysqld started
140527  8:12:41 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140527  8:12:41 [Warning] option 'max_join_size': unsigned value 18446744073709551615 adjusted to 4294967295
140527  8:12:41  InnoDB: Started; log sequence number 0 43655
140527  8:12:41 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.0.77'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  Source distribution

I am not sure why it says zero hosts and services. There are over a hundred hosts with their respective services being monitored from this instance of NagiosXI.

Thanks for all the help so far.