Failure after restore and upgrade
-
- Posts: 51
- Joined: Tue Oct 16, 2012 9:45 am
Failure after restore and upgrade
Upgraded a development NagiosXI box from 2012r1 to 2012r3, restored a 2012r1 backup to it from our production NagiosXI and its not unable to start ndo2db, claiming the library is missing, I expect its just a symbolic link that needs updating but can this be confirmed
Starting ndo2db:/usr/local/nagios/bin/ndo2db: error while loading shared libraries: libmysqlclient.so.15: cannot open shared object file: No such file or directory
I've just run the upgrade again and its still wont start up
[root@nagiosxi nagiosxi]# service ndo2db status
ndo2db is not running but subsystem locked
[root@nagiosxi nagiosxi]#
Starting ndo2db:/usr/local/nagios/bin/ndo2db: error while loading shared libraries: libmysqlclient.so.15: cannot open shared object file: No such file or directory
I've just run the upgrade again and its still wont start up
[root@nagiosxi nagiosxi]# service ndo2db status
ndo2db is not running but subsystem locked
[root@nagiosxi nagiosxi]#
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
- Contact:
Re: Failure after restore and upgrade
I am a little confused which path you took... 2012r3 doesn't exist yet.
Are these machines on the same architecture (32/64 bit)?
Are these machines on the same architecture (32/64 bit)?
-
- Posts: 51
- Joined: Tue Oct 16, 2012 9:45 am
Re: Failure after restore and upgrade
typo 2012r2
Production Box
[root@NagiosXI proc]# cat cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 15
model name : Intel(R) Xeon(R) CPU E5345 @ 2.33GHz
stepping : 1
cpu MHz : 2333.331
cache size : 4096 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflui ssse3 cx16 lahf_lm [8]
bogomips : 4666.66
Development Server
[root@nagiosxi proc]# cat cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 15
model name : Intel(R) Xeon(R) CPU 5150 @ 2.66GHz
stepping : 6
cpu MHz : 2666.761
cache size : 4096 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss lm constant_tsc arch_perfmon pebs bt s tsc_reliable nonstop_tsc aperfmperf unfair_spinlock pni ssse3 cx16 hypervisor lahf_lm dts
bogomips : 5333.52
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
They are both using 4 cores but not listed them as irrelevant, only CPU 0 listed
The development box did start out as the downloadable VM (XI2012) image but so did the production (XI2011) but some time ago. I've run the upgrade to 2012r2 before and after the restore.
Production Box
[root@NagiosXI proc]# cat cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 15
model name : Intel(R) Xeon(R) CPU E5345 @ 2.33GHz
stepping : 1
cpu MHz : 2333.331
cache size : 4096 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflui ssse3 cx16 lahf_lm [8]
bogomips : 4666.66
Development Server
[root@nagiosxi proc]# cat cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 15
model name : Intel(R) Xeon(R) CPU 5150 @ 2.66GHz
stepping : 6
cpu MHz : 2666.761
cache size : 4096 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss lm constant_tsc arch_perfmon pebs bt s tsc_reliable nonstop_tsc aperfmperf unfair_spinlock pni ssse3 cx16 hypervisor lahf_lm dts
bogomips : 5333.52
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
They are both using 4 cores but not listed them as irrelevant, only CPU 0 listed
The development box did start out as the downloadable VM (XI2012) image but so did the production (XI2011) but some time ago. I've run the upgrade to 2012r2 before and after the restore.
-
- Posts: 51
- Joined: Tue Oct 16, 2012 9:45 am
Re: Failure after restore and upgrade
It was running fine with a restore of XI2011 onto the bare XI2012, that did work but once I'd upgraded to 2012r2 and did a restore now production is on XI2012r1 and dev on XI2012r2 it seems to have killed ndo2db. I'd like to be able to upgrade production to 2012r2 but cannot risk at present, would have thought an XI2012r1 backup would work to an XI2012r2 VM thats almost brand new, only thing I have changed was the drive sizes but went through the XI guide on doing so without issues.
Worst case scenario is that I'll have to start with a new VM image and try the restore on that instead but think this is just a minor issue and probably less work to resolve, what do you think?
Worst case scenario is that I'll have to start with a new VM image and try the restore on that instead but think this is just a minor issue and probably less work to resolve, what do you think?
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
- Contact:
Re: Failure after restore and upgrade
on each machine please run
Code: Select all
uname -a
-
- Posts: 51
- Joined: Tue Oct 16, 2012 9:45 am
Re: Failure after restore and upgrade
Production Linux NagiosXI.int.ascribe.com 2.6.18-238.9.1.el5 #1 SMP Tue Apr 12 18:10:56 EDT 2011 i686 i686 i386 GNU/Linux
Development Linux nagiosxi.int.ascribe.com 2.6.32-279.14.1.el6 #1 SMP Tue Nov 6 21:05:14 UTC 2012 i686 i686 i386 GNU/Linux
Is this fixable?
Development Linux nagiosxi.int.ascribe.com 2.6.32-279.14.1.el6 #1 SMP Tue Nov 6 21:05:14 UTC 2012 i686 i686 i386 GNU/Linux
Is this fixable?
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
- Contact:
Re: Failure after restore and upgrade
Would you be available around 3:30pm CST today for a remote session to assist you with this? If so PM me your email address and I will send a connection link.
-
- Posts: 51
- Joined: Tue Oct 16, 2012 9:45 am
Re: Failure after restore and upgrade
Got tied down adding a large new client so just picked this up again.
Update, I've rebuilt from a fresh x86 OVF template and expanded the disk to 80 GB so I can restore OK, ran a backup on production, scp'd over to new VM and ran restore, last message on completing restore is
Starting ndo2db:/usr/local/nagios/bin/ndo2db: error while loading libraries: libmysqlclient.so.15: cannot open shared object file: No such file or directory
Nagios reports database backend not working but subsystem locked.
I'm working 11pm-7am UK time tomorrow so could be available for a remote session if thats still on the cards
Could you also add my username to the customer list as we have just sorted 12 months support and its not been added, thanks
Update, I've rebuilt from a fresh x86 OVF template and expanded the disk to 80 GB so I can restore OK, ran a backup on production, scp'd over to new VM and ran restore, last message on completing restore is
Starting ndo2db:/usr/local/nagios/bin/ndo2db: error while loading libraries: libmysqlclient.so.15: cannot open shared object file: No such file or directory
Nagios reports database backend not working but subsystem locked.
I'm working 11pm-7am UK time tomorrow so could be available for a remote session if thats still on the cards
Could you also add my username to the customer list as we have just sorted 12 months support and its not been added, thanks
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
- Contact:
Re: Failure after restore and upgrade
on the new system lets run
Code: Select all
cd /tmp
rm -rf nagiosxi xi*
wget http://assets.nagios.com/downloads/nagiosxi/xi-latest.tar.gz
tar xzf xi*.tar.gz
cd /tmp/nagiosxi/subcomponents/ndoutils
./upgrade
-
- Posts: 51
- Joined: Tue Oct 16, 2012 9:45 am
Re: Failure after restore and upgrade
I appear to have fixed it, I took a snapshot of the VM before I made these changes so if I have messed it up I should be able to restore....
[/size]
I would appreciate your feedback on this solution as without extensive checking I'm not sure if it just "appears" to be fixed
Code: Select all
wget -O /usr/lib/libmysqlclient.so.15 http://files.directadmin.com/services/es_5.0/libmysqlclient.so.15
chmod 755 /usr/lib/libmysqlclient.so.15
ldconfig
yum install libssl.so.6
service ndo2db start
I would appreciate your feedback on this solution as without extensive checking I'm not sure if it just "appears" to be fixed
