V5.2 Issue: Nagios service dies during Apply Configuration

[WillemDH]

@Sean Does this mean we would better wait with upgrading when using Mod Gearman?

[ssax]

I can't say for sure at this point, I would say do it on a test server first, I'm not sure what's causing this but I believe another customer is experiencing it in 2014R2.7.

[rajasegar]

I can't say for sure at this point, I would say do it on a test server first, I'm not sure what's causing this but I believe another customer is experiencing it in 2014R2.7.

I can confirm that this problem is not related to R5.x. I had the same issue since 2014R2.x.

[tgriep]

Lets see if there is anything in the log files. Can you run the following and post the output?

Code: Select all

grep -i gearman /var/log/messages*

Can you look at the mod_gearman_neb.log files in the /var/log/mod_gearman folder for any errors?

[rajasegar]

Lets see if there is anything in the log files. Can you run the following and post the output?

Code: Select all

grep -i gearman /var/log/messages*

Can you look at the mod_gearman_neb.log files in the /var/log/mod_gearman folder for any errors?

NEB log.

Code: Select all

[2015-10-13 09:07:41][22676][ERROR] sending job to gearmand failed: flush(GEARMAN_COULD_NOT_CONNECT) localhost:4730 -> libgearman/connection.cc:745

Worker log. Only error found in the mod_gearman_worker is below. The rest is all 90s timeout INFO.

Code: Select all

[2015-10-13 09:07:39][18121][ERROR] sending job to gearmand failed: flush(GEARMAN_COULD_NOT_CONNECT) localhost:4730 -> libgearman/connection.cc:745
[2015-10-13 09:07:39][25394][ERROR] sending job to gearmand failed: flush(GEARMAN_COULD_NOT_CONNECT) localhost:4730 -> libgearman/connection.cc:745
[2015-10-13 09:07:39][24732][ERROR] sending job to gearmand failed: flush(GEARMAN_COULD_NOT_CONNECT) localhost:4730 -> libgearman/connection.cc:745
[2015-10-13 09:07:39][32654][ERROR] sending job to gearmand failed: flush(GEARMAN_COULD_NOT_CONNECT) localhost:4730 -> libgearman/connection.cc:745
[2015-10-13 09:07:39][25155][ERROR] sending job to gearmand failed: flush(GEARMAN_COULD_NOT_CONNECT) localhost:4730 -> libgearman/connection.cc:745

Nagios support did all the checking before, no errors anywhere except in nagios.log
Caught SIGSEGV, shutting down...

[tgriep]

We were hoping to find something useful. Thanks for looking for us.

[SteveBeauchemin]

I noticed that the XI5 install touches Firewall stuff.

I have my iptables and firewall off, but the install turns it back on.

Maybe something there? Gearman cannot talk to it's local port?

Steve B

[hsmith]

I noticed that the XI5 install touches Firewall stuff.

I have my iptables and firewall off, but the install turns it back on.

Is this the fullinstall or the upgrade? I had a suspicion about this the other day, so I turned my IPTables off on my 2.7 machine, and ran the upgrade to XI5, and it didn't turn my firewall back on.

[rajasegar]

I noticed that the XI5 install touches Firewall stuff.

I have my iptables and firewall off, but the install turns it back on.

Maybe something there? Gearman cannot talk to it's local port?

Steve B

As far as I know firewall does not restrict local port access only external.

[ssax]

rajasegar, please post a sanitized copy of your mod_gearman_neb.conf and your mod_gearman_worker.conf files.

Thank you