Page 2 of 3

Re: mod-gearman |showing false device down

Posted: Wed May 08, 2019 12:40 pm
by progressive.nagiosXI
Hi ,

when mod-gearman error occured we check logs and find below
1.on remote(worker) ,no error found in logs .
2.in Nagiosxi server no log generate at error time but only one error write in logs by nagiosxi,PFA

Re: mod-gearman |showing false device down

Posted: Thu May 09, 2019 1:48 pm
by tgriep
Those errors suggest that the Gearman Server cannot connect to the worker.
If you run the following command on the Nagios server, it will show you what workers the Gearman server knows about.

Code: Select all

gearman_top2 -b
If one of the Queues have a lot of Jobs waiting, then that worker is not retrieving the checks so try and restart the worker to see if it starts to process the checks.

Re: mod-gearman |showing false device down

Posted: Sun May 12, 2019 6:41 am
by progressive.nagiosXI
Hi ,

still we are not able to restart gearmand service manually in Nagiosxi.

Our Nagiosxi vendor (Nagios Technical Expert ) from where we purchased nagiosxi ,check our profile and gearmand logs and suggest below status.

"[Based on the log we have identified there is are issues in the configuration done for Mod-gearman.

Based on the Mod_gearman logs the worker is unable to find checks on the system and is restarting the same every time. We have to make the changes on the mod_gearmam end and do the reconfiguration]
."

Nagios Team Please help for below steps :-
can we remove gearman and reinstall again with fresh setting in NagiosXi(please share documentation)
or
Help us to reset all configuration,version,modules etc

Thanks

Re: mod-gearman |showing false device down

Posted: Mon May 13, 2019 8:40 am
by tgriep
If you want to remove and reinstall Mod Gearman, the following links are what you need.
The first one removes Gearman and upgrades Nagios Core.
https://support.nagios.com/kb/article.php?id=839

This link has the instrictions for reinstalling Mod Gearman.
https://assets.nagios.com/downloads/nag ... ios_XI.pdf

If you want to continue on trying to get Mod Gearman Working, I will need the following files form all of the Gearman Workers and the Nagios server if they exist.

Code: Select all

/etc/mod_gearman2/worker.conf
/etc/mod_gearman2/module.conf
/var/log/gearmand/gearmand.log
/var/log/mod_gearman2/mod_gearman_neb.log
/var/log/mod_gearman2/mod_gearman_worker.log
And, you need to run these commands as root on the Nagios Server and post the output here.

Code: Select all

ps -ef
gearman_top2 -b
You should review this article on how to setup Mod Gearman.
https://support.nagios.com/kb/article/n ... s-484.html

Re: mod-gearman |showing false device down

Posted: Fri May 17, 2019 12:14 pm
by progressive.nagiosXI
Details shared in PM ,please suggest

Re: mod-gearman |showing false device down

Posted: Fri May 17, 2019 3:20 pm
by cdienger
Unfortunately @tgriep is out today. Can you PM me the files?

Re: mod-gearman |showing false device down

Posted: Mon May 20, 2019 9:00 am
by tgriep
Do you have a remote Mod Gearman worker setup to process this hostgroup called HTMEDIA?
That worker seems to not be processing the jobs so you should try resetting the Mod Gearman worker on that server to see if it starts to process the jobs.

If that does not work, we will need to see the worker.conf file from that server and the /var/log/mod_gearman2/mod_gearman_worker.log file.

Thanks.

Re: mod-gearman |showing false device down

Posted: Mon May 20, 2019 12:11 pm
by progressive.nagiosXI
Hi ,

worker server details for given host group has been shared in PM,Please also check this and suggest(load average of hub-server always high)

Further log details we will share tommorow

Thanks

Re: mod-gearman |showing false device down

Posted: Mon May 20, 2019 12:53 pm
by tgriep
The check_nwc_healts plugin is a fairly large perl script that does take a log od resources to run so on a large server that has a lot of them running, it would make the load fairly high.
Your worker is running a lot of those checks so that is normal.
You can try and find an alternative plugin that does not load the system as much or run the checks less frequently to help out on the load of the server.

Your PM did not include the worker.conf file from the Gearman Worker server and the /var/log/mod_gearman2/mod_gearman_worker.log file so I would need to see them to continue on.

Re: mod-gearman |showing false device down

Posted: Tue May 21, 2019 11:56 am
by progressive.nagiosXI
details shared in PM