Apply Configuration Never Completes

[Bitflogger]

I have seen https://www.google.com/search?source=hp ... C1EPXuT6pg

It does not list the cause I have identified.

I create objects with almost no information, then connect them to a template. If I forget to connect one to a template, then the apply configuration does not complete.

The problem for me is, if a number of people are changing the configuration, it may be hard to track down which object is missing a template reference.

[scottwilkerson]

If Apply configuration errors it should have a "show errors" button.

Also, if you want to write and verify the configutation you can do so under CCM -> Tools -> Config File Management

[Bitflogger]

Hello,

It does not show an error, the dots, just keep going ...........................................

The command line verify works fine, probably since the problem configuration has not been written yet.

I forgot to say, my version is 5.5.0.

[scottwilkerson]

Can you grab the usr/local/nagiosxi/var/cmdsubsys.log off the system and add it to the thread.

[Bitflogger]

cmdsubsys.log

Please see attached file

[scottwilkerson]

Can you run the following:

Code: Select all

ll /usr/local/nagiosxi/scripts/reconfigure_nagios.lock
service crond status
chage -l nagios

[Bitflogger]

[ead@winston ~]$ ls -al /usr/local/nagiosxi/scripts/recon*
-rwxr-x--- 1 nagios nagios 971 Jul 3 08:56 /usr/local/nagiosxi/scripts/reconfigure_nagios.sh
[ead@winston ~]$
[ead@winston ~]$ sudo service crond status
Redirecting to /bin/systemctl status crond.service
● crond.service - Command Scheduler
Loaded: loaded (/usr/lib/systemd/system/crond.service; enabled; vendor preset: enabled)
Active: active (running) since Wed 2018-07-18 16:19:07 CDT; 6 days ago
Main PID: 915 (crond)
CGroup: /system.slice/crond.service
└─915 /usr/sbin/crond -n

Jul 20 12:33:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 20 12:39:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 20 12:50:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 20 12:54:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 20 16:36:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 20 16:42:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 23 14:50:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 23 14:59:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 23 15:16:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
Jul 24 13:15:01 winston.doit.wisc.edu crond[915]: (*system*) RELOAD (/etc/cron.d/nagiosxi)
[ead@winston ~]$ which cage
/usr/bin/which: no cage in (/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin:/opt/OV/bin:/opt/OV/bin/OpC:/opt/OV/bin/OpC/utils:/opt/OV/contrib/OpC:/opt/local/nagios-helpers:/home/ead/.local/bin:/home/ead/bin)
[ead@winston ~]$ sudo chage -l nagios
Last password change : May 01, 2018
Password expires : never
Password inactive : never
Account expires : never
Minimum number of days between password change : 7
Maximum number of days between password change : 99999
Number of days of warning before password expires : 7
[ead@winston ~]$ sudo ll /usr/local/nagiosxi/scripts/reconfigure_nagios.lock
sudo: ll: command not found

[scottwilkerson]

it is

Code: Select all

chage -l nagios

also run the following

Code: Select all

tail -30 /var/log/cron

Additionally under Admin -> System Status

is everything green?

[Bitflogger]

[ead@winston ~]$ sudo chage -l nagios
Last password change : May 01, 2018
Password expires : never
Password inactive : never
Account expires : never
Minimum number of days between password change : 7
Maximum number of days between password change : 99999
Number of days of warning before password expires : 7
[ead@winston ~]$ sudo tail -30 /var/log/cron
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8021]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/deadpool.php >> /usr/local/nagiosxi/var/deadpool.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8022]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php >> /usr/local/nagiosxi/var/reportengine.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8028]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php >> /usr/local/nagiosxi/var/cleaner.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8027]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php >> /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8026]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php >> /usr/local/nagiosxi/var/nom.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8034]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php >> /usr/local/nagiosxi/var/eventman.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8031]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/event_handler.php >> /usr/local/nagiosxi/var/event_handler.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8033]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php >> /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8035]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php >> /usr/local/nagiosxi/var/feedproc.log 2>&1)
Jul 25 11:47:01 winston.doit.wisc.edu CROND[8032]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php >> /usr/local/nagiosxi/var/sysstat.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12933]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php >> /usr/local/nagiosxi/var/nom.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12935]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/event_handler.php >> /usr/local/nagiosxi/var/event_handler.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12936]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php >> /usr/local/nagiosxi/var/eventman.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12940]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php >> /usr/local/nagiosxi/var/reportengine.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12943]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/deadpool.php >> /usr/local/nagiosxi/var/deadpool.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12944]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php >> /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12945]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php >> /usr/local/nagiosxi/var/sysstat.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12938]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php >> /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12939]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php >> /usr/local/nagiosxi/var/feedproc.log 2>&1)
Jul 25 11:48:01 winston.doit.wisc.edu CROND[12941]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php >> /usr/local/nagiosxi/var/cleaner.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17571]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/deadpool.php >> /usr/local/nagiosxi/var/deadpool.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17570]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php >> /usr/local/nagiosxi/var/reportengine.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17578]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php >> /usr/local/nagiosxi/var/sysstat.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17592]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php >> /usr/local/nagiosxi/var/feedproc.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17593]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/event_handler.php >> /usr/local/nagiosxi/var/event_handler.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17601]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php >> /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17599]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php >> /usr/local/nagiosxi/var/cleaner.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17597]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php >> /usr/local/nagiosxi/var/eventman.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17594]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php >> /usr/local/nagiosxi/var/nom.log 2>&1)
Jul 25 11:49:01 winston.doit.wisc.edu CROND[17598]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php >> /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
[ead@winston ~]$

Everything is green, see screen print.

systemstatus.png

[gormank]

I use templates as the OP describes as well and have seen similar (seems to) runs forever behavior...
I'd check for a lock file as described above, and run the reconfigure script from the shell and see what it says to get clues.