Network Outage Widget Error

[lntinfo]

Hi Rdedon,

I have done this steps twices, after follow this steps its start working all, but after some time aging its going to the same state. Pls. find the below var/log/httpd error log

Nagios service also going to stop automatically.....

[Mon Mar 21 20:13:41 2011] [error] [client xx.xx.xx.xx] PHP Notice: Undefined variable: msg in /usr/local/nagiosxi/html/includes/components/xicore/status.php on line 317, referer: http://xx.xx.xx.xx/nagiosxi/
[Mon Mar 21 20:13:41 2011] [error] [client xx.xx.xx.xx] PHP Notice: Undefined variable: msg in /usr/local/nagiosxi/html/includes/components/xicore/status.php on line 317, referer: http://xx.xx.xx.xx/nagiosxi/
[Mon Mar 21 20:14:13 2011] [error] [client xx.xx.xx.xx] Notice: Undefined variable: msg in /usr/local/nagiosxi/html/includes/components/xicore/status.php on line 317, referer: http://xx.xx.xx.xx/nagiosxi/index.php
[Mon Mar 21 20:14:13 2011] [error] [client xx.xx.xx.xx] PHP Notice: Undefined variable: msg in /usr/local/nagiosxi/html/includes/components/xicore/status.php on line 317, referer: http://xx.xx.xx.xx/nagiosxi/index.php
[Mon Mar 21 20:14:18 2011] [error] [client xx.xx.xx.xx] File does not exist: /usr/local/nagiosxi/html/includes/components/nagioscore/ui/image

[rdedon]

I had one of our developers look at this and he will do some research on it as well.

[mguthrie]

Lets first make sure all of the necessary services started correctly. Try restarting ndoutils and mysql:

service mysqld restart
service ndo2db restart

Also, see the following document and make sure there aren't any damaged tables in mysql:
http://assets.nagios.com/downloads/nagi ... tabase.pdf

[lntinfo]

mguthrie,

I have done the all suggestions but still same problem, I have found the problem the nagios service is stopping automatically, I am try to start that but its hanging. After restart the server some time its working fine then the problem accruing.

Pls. find the attachment for more information.


Regards,
Sivakumar

[mguthrie]

Yeah, this appears to be a bug that a few users are experiencing, we're working on isolating it and getting it fixed ASAP.

If you can send us output from the following two logs just so we can confirm it's the same issue.

Code: Select all

tail /var/log/messages
tail /usr/local/nagios/var/nagios.log

Also, if you run

Code: Select all

ps aux | grep nagios | less

and see if you have several copies of a dbmaint.php script being run.



Here are a couple of things you can do in the meantime.

Code: Select all

service nagios stop
service ndo2db stop
service mysqld stop

/usr/local/nagiosxi/scripts/repairmysql.sh nagios *

Once that is complete, restart your services and see if things improve.

Code: Select all

service mysqld start
service ndo2db start
service nagios start

If your event queue still looks the way it does in that image, do the following. Note: This will force nagios to grab fresh check results for everything, so all of your hosts and services will temporarily be in a pending state. The reaper settings will also allow Nagios to process more results in a shorter period of time to prevent the scheduling queue from backing up.

Code: Select all

service nagios stop
rm -f /usr/local/nagios/var/retention.dat

Edit the following two settings in your /usr/local/nagios/etc/nagios.cfg file to look like the following.

Code: Select all

check_result_reaper_frequency=3

max_check_result_reaper_time=10

Then start nagios back up.

Code: Select all

service nagios start

[lntinfo]

Hi,

Any update on this? after done tha all setup which has you provided find the attached current status.

Sivakumar

[mguthrie]

You may be experiencing table corruption in your ndoutils table. If you're using Xi-version2011 I suggest following the repair procedure outlined below and then updating to the latest release (2011R1.2).
http://assets.nagios.com/downloads/nagi ... tabase.pdf


If you're using Xi-2009, follow the instructions on the below link.
http://support.nagios.com/wiki/index.ph ... s_Stale.22


Otherwise, the Monitoring Engine Event Queue makes an ajax call to one of google's API's. Do you have any firewall settings that might be blocking that?

[lntinfo]

Hi,

Pls. find the attached screenshoot for latest error after done the all suggetions.
Pls. do the needful at earliest.

Sivkumar

[rdedon]

If you haven't already could you please restart the server and respond back with results?

Thank you.

[lntinfo]

Hi,

Same errors and I am unable to perform the backup. Pls. find the below error I am getting.

nagiosql.export.monitoring
[root@poinmsnagios01 scripts]# ./backup_xi.sh
Backing up Core Config Manager (NagiosQL)...
tar: Removing leading `/' from member names
tar: Removing leading `/' from member names
Backing up Nagios Core...
tar: Removing leading `/' from member names
tar: /usr/local/nagios/var/ndo.sock: socket ignored
Backing up Nagios XI...
tar: Removing leading `/' from member names
Backing up MySQL databases...
mysqldump: Got error: 144: Table './nagios/nagios_servicestatus' is marked as crashed and last (automatic?) repair failed when using LOCK TABLES
Error backing up MySQL database 'nagios' - check the password in this script!
You have new mail in /var/spool/mail/root