Page 2 of 5
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Tue Sep 05, 2017 1:47 pm
by emartine
Gearman Packages currently installed on Main Server (gearman worker not running however):
gearmand-server-0.33-2.x86_64
mod_gearman2-2.1.1-1.el6.x86_64
gearmand-devel-0.33-2.x86_64
gearmand-0.33-2.x86_64
Workers all have
gearmand-devel-0.33-2.x86_64
gearmand-0.33-2.x86_64
libgearman-1.1.8-2.el6.x86_64
mod_gearman-1.4_nagios4-1.el6.x86_64
mod_gearman2-2.1.1-1.el6.x86_64
Processes are running:
/usr/bin/mod_gearman2_worker -d --config=/etc/mod_gearman2/worker.conf --pidfile=/var/mod_gearman2/mod_gearman_worker.pid
These values were changed to the below values:
max_execution_time = 120
max_input_time = 120
memory_limit = 512M
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Tue Sep 05, 2017 4:04 pm
by tgriep
Did you add this to the /etc/php.ini file?
If not add it.
Also, change the memory limit to the following
memory_limit = 1024M
Save the file and restart the following
Code: Select all
service httpd restart
service nagios restart
Did you do the changes in this link?
https://support.nagios.com/kb/article/n ... anner.html
Is the Apply Configuration working for you now?
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Wed Sep 06, 2017 11:23 am
by emartine
Yes. max_input_vars=5000 was added.
I have also just changed memory limit to 1024M
I also made the changes to reflect:
for i in {1..40} I had 1..30 before
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Wed Sep 06, 2017 2:06 pm
by tgriep
Is the Apply Configuration working for you now?
If not, can you login to the XI server as root and run this command,
Code: Select all
tail -f /usr/local/nagiosxi/var/cmdsubsys.log
Then login to the XI GUI and Apply the configuration and post the output of the tail command.
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Tue Sep 12, 2017 2:40 pm
by emartine
On my DR box (manual DR)
I added 6 hosts. and I am seeing the checks going back and forth between being ok and Down with the status info of (host check orphaned, is the mod-gearman worker on queue 'host' running?)
Logs show alot of these:
[1505244751] Warning: The check of service 'Total Processes' on host 'server' looks like it was orphaned (results never came back; last_check=1505243890; next_check=1505244070). I'm scheduling an immediate check of the service...
/var/log/mod_gearman2/mod_gearman_neb.log shows:
[2017-09-12 05:00:03][46277][ERROR] sending job to gearmand failed: connect_poll(Connection refused) getsockopt() failed -> libgearman/connection.cc:104
[2017-09-12 12:09:02][29186][ERROR] sending job to gearmand failed: connect_poll(Connection refused) getsockopt() failed -> libgearman/connection.cc:104
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Tue Sep 12, 2017 3:20 pm
by emartine
BTW the prod server seems to be stable for now.
This DR box however doesn't seem to be.
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Wed Sep 13, 2017 8:49 am
by tgriep
I did some searching on that error and from what I found, it it caused by the gearmand server not listening for any new connections and that it is a possible bug in the software.
You can try and upgrade the gearman software or enable debugging in the gearmand module.conf file and see if there is more information in the log file on why it is failing.
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Wed Sep 13, 2017 9:28 am
by emartine
I tried upgrading. Following
https://assets.nagios.com/downloads/nag ... ios_XI.pdf
I noticed that when I did the server upgrade first and then the worker upgrade that the worker upgrade removed components of the server. So I had to do a straight install and eventually all of the packages were available.
gearmand-0.33-2.x86_64
gearmand-devel-0.33-2.x86_64
mod_gearman2-2.1.1-1.el6.x86_64
gearmand-server-0.33-2.x86_64
I seem to be at the latest version. Is this not the case?
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Wed Sep 13, 2017 10:09 am
by emartine
After restarting gearman with debug mode on. It seems to have cleared everything up. Not sure how long this will last however. I will keep you posted.
Re: Nagios XI 5.4.4 Appluconfiguration taking forever
Posted: Wed Sep 13, 2017 10:15 am
by tgriep
Those versions are the last known versions that were tested on a Nagios XI server.
If you go to the Gearman web site, there are newer versions available but we do not have any instructions for installing the newer versions.