Error: No output from backend!

[blalande]

Hello,

I'm running Nagios XI 2014R2.7 on rhel 6.9 64bits server.
I have relocated the mysql server to a remote one using the procedure: https://assets.nagios.com/downloads/nag ... Server.pdf
nagiosxi db is still running on local postgresql server.

Since then it looks like everything works but services status are not updated in service status page and I have a noification: "Host Checks Are Disabled, Active Service Checks Are Disabled"

Also in the monitoring Engine Status page, Monitoring engine event queue shows : "Error: No output from backend!" and Process Info is showing only process state is red and Process End Time with no status.

If I try to start Process Info, I got this error in cmdsubsys.log:

PROCESS COMMAND: CMD=11, DATA=a:1:{i:0;s:0:"";}
CMDLINE=sudo /usr/local/nagiosxi/scripts/manage_services.sh start nagios
Starting nagios: another instance of nagios is already running.
OUTPUT=Starting nagios: another instance of nagios is already running.
RETURNCODE=0
.....tail: cmdsubsys.log: file truncated

PROCESSED 1 COMMANDS

I can see from my monitored servers that nagios is runing active checks, or in each Service status detail /preformance graph that the check is running and all historical data, but in the overview pane, the last check is yesterday...

Any help welcome!

Cheers

[scottwilkerson]

Can you run the following

Code: Select all

service nagios stop
service ndo2db stop
killall -9 nagios
killall -9 ndo2db
service ndo2db start
service nagios start

If the problem persists, verify you did EVERY step in that document.

If still no luck, please send system profile.zip from Admin -> System Profile

[blalande]

I found ndo2db.cfg file was not configured corectly (reverted to its inital values). I can't figoure out how it happpened.

Now Service status shows correct lats check date.


Other issue still present, I will send you profile.zip in PM

Cheers

[scottwilkerson]

Which other issue is still present?

Also, I did not get the profile via PM

[blalande]

I still have these issues:
I have a noification: "Host Checks Are Disabled, Active Service Checks Are Disabled"

Also in the monitoring Engine Status page, Monitoring engine event queue shows : "Error: No output from backend!" and Process Info is showing only process state is red and Process End Time with no status.

If I try to start Process Info, I got this error in cmdsubsys.log:

PROCESS COMMAND: CMD=11, DATA=a:1:{i:0;s:0:"";}
CMDLINE=sudo /usr/local/nagiosxi/scripts/manage_services.sh start nagios
Starting nagios: another instance of nagios is already running.
OUTPUT=Starting nagios: another instance of nagios is already running.
RETURNCODE=0
.....tail: cmdsubsys.log: file truncated

PROCESSED 1 COMMANDS

I sent again profile in PM

[scottwilkerson]

Your system log is showing a bunch of lines like this

Code: Select all

Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock'

Lets try to start mysql

Code: Select all

service mysqld start

[blalande]

mysqld is stopped, as I have relocated mysql db to a remote server...
Only nagiosxi is running on a local postgresql server.

Edit:
My bad I sent an outdated zip file...

I just sent you the latest one

[scottwilkerson]

But then you must have missed one of the configurations because before.. Now I have a new profile with a different error from the DB to manage

Code: Select all

mysql_error: 'Data too long for column 'command_line' at row 1'

This suggests you moved the DB to a newer one that had STRICT_TRANS_TABLES on by default, please follow the following doc to change this

https://support.nagios.com/kb/article/n ... s-780.html

[blalande]

The parameter change in mysql solved my issues.

Anyway after modifying the mysql db mode, I stopped/started no2db and nagios, and then "Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock'" errors appeared again.
I noticed the ndo2db.cfg file "reverted itself" to an old version (more than 1 month old), with local mysql server settings...

Do you know how it can happen?

After ndo2db stop, ndo2db.cfg change, and start, my issue was gone.

Thanks for your help

[scottwilkerson]

The only thing I can think that would cause this is if you Applied configuration and it failed, then the system automatically reverts to where it was at the last snapshot (which may be before you changed the ndo2db.cfg).

The best thing you could do is try to apply configuration and get that sorted out making sure you replace the ndo2db.cfg config after each time it fails until you get a good apply configuration snapshot as the latest.