Error - Backend login to the core config manager failed

[olabisid]

We are getting "Backend Login to the Core Config Manager failed" error when trying to add new hosts for monitoring. we are running latest v5.6.6


when we run /usr/local/nagiosxi/scripts/reconfigure_nagios.sh, we get the following error when importing ccm

> Setting import directory: /usr/local/nagios/etc/import/
> Importing config files into the CCM
- Importing: /usr/local/nagios/etc/import/CLT-PBX.cfg .. ERROR
Field 'display_name' doesn't have a default valueEntry config_name::-CLT-PBX inside tbl_service could not be inserted: 1<br>
- Importing: /usr/local/nagios/etc/import/pPRIJvjW.tmp.cfg .. ERROR
Field 'alias' doesn't have a default valueEntry config_name::CLT-PBX inside tbl_service could not be inserted: 1<br>Entry host_name::CLT-PBX inside tbl_host could not be inserted: 1<br>


also noticed that we are unable to modify existing hosts. when we tried we got an error:

Error: Service has no hosts and/or service_description (config file '/usr/local/nagios/etc/services/xxxx-net2.local.cfg', starting on line 50)
Error processing object config files!


***> One or more problems was encountered while processing the config files...

[benjaminsmith]

Hello @olabisid,

You have a file in the import directory that is failing:

- Importing: /usr/local/nagios/etc/import/CLT-PBX.cfg .. ERROR

Are importing configurations? If so, it's necessary to follow the exact order starting with the configuration file for Commands and ending with Servie Groups.

See: Importing Config Files Into Nagios XI

Try temporarily moving the configuration files out of /usr/local/nagios/etc/import, and then Apply Configuration again. You can run the following tail command from the command line to capture any errors and post the output for us to review. Thanks.

Code: Select all

tail -f /usr/local/nagiosxi/var/cmdsubsys.log

[olabisid]

pls see output of tail command

PROCESSED 0 COMMANDS
.............................................................
PROCESSED 0 COMMANDS
............................................................
PROCESSED 0 COMMANDS
...........................................................
PROCESSED 0 COMMANDS
.............................................................
PROCESSED 0 COMMANDS
...........................................................
PROCESSED 0 COMMANDS
..........................................PROCESSING COMMAND ID 1151...
PROCESS COMMAND: CMD=17, DATA=
APPLYING NAGIOSCORE CONFIG...
CMDLINE=cd /usr/local/nagiosxi/scripts && ./reconfigure_nagios.sh

--- reset_config_perms.sh ------------
> Setting script permissions
> Setting CCM script permissions
> Setting special script permissions
> Setting special component script permissions
> Setting configuration file/directory permissions
> Setting perfdata directory and RRD permissions
> Setting libexec directory permissions
> Setting Nagios XI config permissions
> Setting NOM checkpoint user:group permissions
> + Setting CCM configuration file user:group permissions
> + Setting Recurring Downtime file user:group permissions
> + Setting BPI configuration file user:group permissions
--------------------------------------

--- ccm_import.php -------------------
> Setting import directory: /usr/local/nagios/etc/import/
> Importing config files into the CCM
- Importing: /usr/local/nagios/etc/import/afdc-net2.afdc.local.cfg .. SUCCESS
--------------------------------------

--- ccm_export.php -------------------
> Writing CCM configuration to Nagios files
Finished writing out configuraton
--------------------------------------

--------------------------------------
> Verifying configuration with Nagios Core
> Output:
Nagios Core 4.4.3
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 2019-01-15
License: GPL

Website: https://www.nagios.org
Reading configuration data...
Read main config file okay...
Error: Service has no hosts and/or service_description (config file '/usr/local/nagios/etc/services/afdc-net2.afdc.local.cfg', starting on line 49)
Error processing object config files!


***> One or more problems was encountered while processing the config files...

Check your configuration file(s) to ensure that they contain valid
directives and data definitions. If you are upgrading from a previous
version of Nagios, you should be aware that some variables/definitions
may have been removed or modified in this version. Make sure to read
the HTML documentation regarding the config files, as well as the
'Whats New' section to find out what has changed.
> Return Code: 1
--------------------------------------
/usr/local/nagiosxi/nom/checkpoints/nagioscore/errors /usr/local/nagiosxi/scripts
tar: Removing leading `/' from member names
/usr/local/nagiosxi/scripts
LATEST NOM SNAPSHOT: /usr/local/nagiosxi/nom/checkpoints/nagioscore/1566825560.tar.gz
/ /usr/local/nagiosxi/scripts
RESTORING NOM SNAPSHOT : /usr/local/nagiosxi/nom/checkpoints/nagioscore/1566825560.tar.gz
tar: usr/local/nagios/etc/hosts: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/hosts: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc/pnp/pages: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/pnp/pages: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc/pnp/check_commands: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/pnp/check_commands: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc/pnp: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/pnp: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc/import: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/import: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc/services: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/services: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc/static: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc/static: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: usr/local/nagios/etc: Cannot utime: Operation not permitted
tar: usr/local/nagios/etc: Cannot change mode to rwxrwxr-x: Operation not permitted
tar: Exiting with failure status due to previous errors
/usr/local/nagiosxi/scripts

--- reset_config_perms.sh ------------
> Setting script permissions
> Setting CCM script permissions
> Setting special script permissions
> Setting special component script permissions
> Setting configuration file/directory permissions
> Setting perfdata directory and RRD permissions
> Setting libexec directory permissions
> Setting Nagios XI config permissions
> Setting NOM checkpoint user:group permissions
> + Setting CCM configuration file user:group permissions
> + Setting Recurring Downtime file user:group permissions
> + Setting BPI configuration file user:group permissions
--------------------------------------
OUTPUT=--------------------------------------
RETURNCODE=1
PROCESSING COMMAND ID 1152...
PROCESS COMMAND: CMD=1150, DATA=remove
CMDLINE=php /usr/local/nagiosxi/html/includes/components/nagiosbpi/api_tool.php --cmd=syncall
........^C

[olabisid]

also, nope, we are not importing configs. all changes are being done on Web UI.

as stated, we are unable to add new hosts, and we are unable to modify existing hosts/services. any changes that require apply configuration is currently failing.

[benjaminsmith]

Hello,

Looking at the output, you still have configuration files in the import directory and it imports afdc-net2.afdc.local.cfg.

--- ccm_import.php -------------------
> Setting import directory: /usr/local/nagios/etc/import/
> Importing config files into the CCM
- Importing: /usr/local/nagios/etc/import/afdc-net2.afdc.local.cfg .. SUCCESS
--------------------------------------

Then later while verifying the configurations, it fails on this file.

Error: Service has no hosts and/or service_description (config file '/usr/local/nagios/etc/services/afdc-net2.afdc.local.cfg', starting on line 49)
Error processing object config files!

Please remove the configuration files from the import directory ( /usr/local/nagios/etc/import ), then run the following command to reset configuration permissions.

Code: Select all

/usr/local/nagiosxi/scripts/reset_config_perms.sh

And try again. If it's still not working, please send over your system profile. Thanks.

To send us your system profile.
Login to the Nagios XI GUI using a web browser.
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and share in a private message and then reply to this post to bring it up in the queue.

[olabisid]

the folder is empty. see ls output below:

[root@NAGIOS ~]# ls /usr/local/nagios/etc/import/
[root@NAGIOS ~]#

sent system profile in private message as requested.

[benjaminsmith]

Hello @olabisid,

Thanks for sending over your system profile. Looking over the database logs there a quite a few bad tables.

2019-08-27T04:43:49.545788Z 1822592 [Note] Aborted connection 1822592 to db: 'nagios' user: 'ndoutils' host: 'localhost' (Got timeout reading communication packets)
2019-08-27T05:15:02.299702Z 1866516 [Warning] InnoDB: Cannot open table nagiosxi/xi_mibs from the internal data dictionary of InnoDB though the .frm file for the table exists. Please refer to http://dev.mysql.com/doc/refman/5.7/en/ ... oting.html for how to resolve the issue.

When did you start experiencing this issue, and have you made any changes to the server? Also, are you maintaining regular backups of Nagios XI?

Please run through the following commands to stop Nagios XI services and repair and truncate the database tables. Let me know if the issue is resolved.

Code: Select all

service npcd stop
service nagios stop
service ndo2db stop
service crond stop
mysqlcheck -f -r -u root -pnagiosxi --all-databases --use-frm
echo "truncate table xi_events; truncate table xi_meta; truncate table xi_eventqueue;" | mysql -u root -pnagiosxi nagiosxi
echo "truncate table nagios_programstatus;" | mysql -u root -pnagiosxi nagios
service mysqld restart
rm -f /usr/local/nagios/var/rw/nagios.cmd
rm -f /usr/local/nagios/var/nagios.lock
rm -f /var/run/nagios.lock
rm -f /usr/local/nagios/var/ndo.sock
rm -f /usr/local/nagios/var/ndo2db.lock
rm -f /var/lib/mrtg/mrtg_l
rm -f /usr/local/nagiosxi/var/*.lock
for i in ipcs -q | grep nagios |awk '{print $2}'; do ipcrm -q $i; done
pkill -9 -u nagios
pkill python
service httpd restart
service ndo2db start
service nagios start
service npcd start
service crond start

[olabisid]

hello there,

it's been a stable environment, so we haven't had to add a new host in about 2 months. just noticed this error for the first time yesterday.

we tried the script you provided and we are still not able to apply changes (it errors out). i have sent you a PM with the screenshots.

[benjaminsmith]

Hello @olabisid,

For faster resolution, I'm going to have you have open a support ticket on this issue.

https://support.nagios.com/tickets/

Please reference this post in the ticket. Thanks.

See: Creating a Ticket in the Support Center

[olabisid]

thanks. we have created ticket.