Nagios Upgrade to 1.5 screwed up scheduling

rajasegar · Post by **rajasegar** » Thu Oct 23, 2014 4:55 am

Nagios XI 2014R1.5

Upgrade from 2014R1.2 to 2104R1.5

Upgrade went smoothly.
Deleted the retention.dat as advised before since it cause the upgraded to R1.4 to mess up the scheduling.

However we still got the scheduling problem.
After about 30 minutes, every service went into time-out.
notify-service-by-emailsms;(service check orphaned, is the mod-gearman worker on queue 'service' running?)

The worst thing is the scheduled event queue graph went dead.
gearman_top kept on spiking up and down.

23-10-2014 05-47-57 PM.png

23-10-2014 05-48-33 PM.png

This is the second time upgrade failed for the same reason.

rajasegar · Post by **rajasegar** » Thu Oct 23, 2014 5:07 am

After reverting back everything went back to normal.

23-10-2014 06-05-33 PM.png

abrist · Post by **abrist** » Thu Oct 23, 2014 11:24 am

Well, we're not be able to troubleshoot if you revert. Do you have a test instance/lab? If so, can you run the upgrade there so that we can proceed troubleshooting towards a resolution for your upgrade path?

rajasegar · Post by **rajasegar** » Thu Oct 23, 2014 6:08 pm

abrist wrote:Well, we're not be able to troubleshoot if you revert. Do you have a test instance/lab? If so, can you run the upgrade there so that we can proceed troubleshooting towards a resolution for your upgrade path?

It is the production monitoring system, we had to revert. Besides that you guy don't work until about 11pm my time.

In the test env, firewall is blocking most of the traffic to the production systems.
Is this ok for troubleshooting?

abrist · Post by **abrist** » Fri Oct 24, 2014 9:33 am

That is fine: the checks will fail but will still get scheduled as usual. That should allow us to troubleshoot the issues.

rajasegar · Post by **rajasegar** » Sun Oct 26, 2014 6:14 pm

abrist wrote:That is fine: the checks will fail but will still get scheduled as usual. That should allow us to troubleshoot the issues.

Ok. Will get back to you guys when I have setup the env.

abrist · Post by **abrist** » Mon Oct 27, 2014 10:07 am

Alright. Lets us know how it goes . . .

rajasegar · Post by **rajasegar** » Thu Nov 06, 2014 3:30 am

I have setup up the production environment.
Will send email to support for remote session.

Post by **lmiltchev** » Thu Nov 06, 2014 10:27 am

Sounds good! Send an email to [email protected] and place "Re: Nagios Upgrade to 1.5 screwed up scheduling" in the email's subject field. Thanks!

rajasegar · Post by **rajasegar** » Thu Nov 06, 2014 5:55 pm

lmiltchev wrote:Sounds good! Send an email to [email protected] and place "Re: Nagios Upgrade to 1.5 screwed up scheduling" in the email's subject field. Thanks!

Already send yesterday (06/11/2014 04:37 PM GMT + 8) with subject Nagios Restart and Nagios 1.5 update issues