Network Outages dashlet Error

[emartine]

Someone brought this to my attention. On our production server, from our tactical overview, the "Network Outages" dashlet is showing:

Error: Unable to parse XML output!
Monitoring engine may be stopped.
Check engine


I click on Check Engine and it seems to be running fine.

I ran a config file management verification check and it shows fine, no errors.

What could be going on with the dashlet?

[emartine]

tail -f /var/log/httpd/error_log
PHP Warning: Invalid argument supplied for foreach() in /usr/local/nagiosxi/html/includes/components/nagiosim/nagiosim.inc.php on line 491
No entry for terminal type "unknown";
using dumb terminal settings.

This is the only error I am getting in this log.

[lmiltchev]

The error that you see in the apache error log is irrelevant. It's just a notice and there is no need to worry about it. Did you have a network outage? Have you made any recent changes to the system, e.g. attempting an upgrade, etc.?

We may need the latest profile from you in order to review all logs. You can PM it to me but before that, let's try stopping/starting services to see if this is going to fix the issue.

Code: Select all

service nagios stop
killall nagios
service ndo2db restart
service nagios restart
service mysqld restart
service mariadb restart # In case you are running mariadb
service crond restart

After you run these commands, run show the output of the following commands in code wraps:

Code: Select all

service nagios status
service ndo2db status
service mysqld status
service mariadb status # In case you are running mariadb
ps -ef | grep cron
chage nagios -l
tail /var/log/mysqld.log
tail /var/log/mariadb/mariadb.log # In case you are running mariadb

Also, verify that the system and PHP time is in sync (Admin > System Profile > View System Info)

[emartine]

I stopped and restarted the services as requested (we are not running mariadb).
Restarting the services didn't seem to help. I've sent you the profile via pm.

No changes or upgrades were made on the system.

Someone just reported to me that they are unable to schedule a server/services in downtime. I verified and although I can submit them it doesn't seem to take effect.

[emartine]

Reviewing the Host Status summary.


When I click on the 3 pending items it shows 0 total records.

Filters: Host= Service=Unknown
Showing 0-0 of 0 total records
No matching services found


When I click on 1 unhandled problem I see 0 total records.
Filters: Host=Down,Unreachable,Not Acknowledged,Not In Downtime Service=Unknown
Showing 0-0 of 0 total records
No matching services found


When I click on the 10 problems it shows 0 total records.
Filters: Host=Down,Unreachable Service=Unknown
Showing 0-0 of 0 total records


I'm starting to review the Service status summary and only some of them are show up proper.

The system is showing ok for all services so I know a change isn't being applied.

Maybe data got corrupted somehow?

[emartine]

Update: if I use the Schedule downtime link in Incident Management I am able to add a host in downtime. But scheduling downtime via the advanced tab on a host or service doesn't work.

[emartine]

tail -f /var/log/httpd/error_log

ERROR 1049 (42000): Unknown database 'nagiosxi'
ERROR 1049 (42000): Unknown database 'nagiosxi'
ERROR 1049 (42000): Unknown database 'nagiosxi'
ERROR 1049 (42000): Unknown database 'nagiosxi'
mysqladmin: connect to server at 'localhost' failed
error: 'Access denied for user 'root'@'localhost' (using password: NO)'
tar: Removing leading `/' from member names
No entry for terminal type "unknown";
using dumb terminal settings.
PHP Warning: Invalid argument supplied for foreach() in /usr/local/nagiosxi/html/includes/components/nagiosim/nagiosi m.inc.php on line 491


Some help is appreciated. This is our production server.

[lmiltchev]

This looks like an issue with ndo even though, I didn't see anything obvious in the profile. When you log into Nagios Core:

Code: Select all

http://ip address/nagios

and check the records, e.g. Ok, Warning, Unknown, etc., what do you see? Do the numbers "match"? Are they the same as the ones in Nagios XI GUI?

[emartine]

Nagios Core says

X Not running



When I click on tactical overview I get


Whoops!

Error: Could not read object configuration data!

[emartine]

I manually ran /usr/local/nagios/bin/nagios -v /usr/local/nagios/etc/nagios.cfg
and I don't see any errors.