3 hours to intall 5.6.9 on 8 cores/32GB???

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
Locked
User avatar
eloyd
Cool Title Here
Posts: 2129
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

3 hours to intall 5.6.9 on 8 cores/32GB???

Post by eloyd »

Trying to install Nagios XI 5.6.9 on an 8 core VM with 32GB of RAM, it took 185 minutes to go from installed (and upgraded) CentOS 7 to not-quite-installed Nagios XI (failed in F-startdaemons). WTF? Is there a problem with the installer?

I see that .10 was released yesterday so I'm going to start over and try installing that, since this didn't even fully work (load average was 27 by the time the install died). Did I mention 8 cores and 32GB RAM?

Code: Select all

--- ccm_export.php -------------------
> Writing CCM configuration to Nagios files
  Finished writing out configuraton
--------------------------------------

--------------------------------------
> Verifying configuration with Nagios Core
> Output:
Nagios Core 4.4.5
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 2019-08-20
License: GPL

Website: https://www.nagios.org
Reading configuration data...
   Read main config file okay...
   Read object config files okay...

Running pre-flight check on configuration data...

Checking objects...
        Checked 13 services.
        Checked 1 hosts.
        Checked 1 host groups.
        Checked 0 service groups.
        Checked 1 contacts.
        Checked 2 contact groups.
        Checked 150 commands.
        Checked 8 time periods.
        Checked 0 host escalations.
        Checked 0 service escalations.
Checking for circular paths...
        Checked 1 hosts
        Checked 0 service dependencies
        Checked 0 host dependencies
        Checked 8 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors:   0

Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
--------------------------------------

CCM data imported OK.
RESULT=0
Running './F-startdaemons'...
Job for httpd.service failed because a fatal signal was delivered to the control process. See "systemctl status httpd.service" and "journalctl -xe" for details.
RESULT=1

===================
INSTALLATION ERROR!
===================
Installation step failed - exiting.
Check for error messages in the install log (install.log).

If you require assistance in resolving the issue, please include install.log
in your communications with Nagios XI technical support.

The script that failed was: './F-startdaemons'

real    185m57.050s
user    117m22.627s
sys     126m36.620s
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoydI'm a Nagios Fanatic!
User avatar
lmiltchev
Former Nagios Staff
Posts: 13587
Joined: Mon May 23, 2011 12:15 pm

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by lmiltchev »

This is definitely not normal. Do you see any additional information in the install.log, which can give us some clues on why the installer failed? Are you behind a proxy?
Be sure to check out our Knowledgebase for helpful articles and solutions!
User avatar
lmiltchev
Former Nagios Staff
Posts: 13587
Joined: Mon May 23, 2011 12:15 pm

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by lmiltchev »

Update: I just tested the 5.6.9 installer of CentOS 7 - it didn't take long to complete:

Code: Select all

Nagios XI Installation Complete!
--------------------------------

You can access the Nagios XI web interface by visiting:
    http://192.168.x.x/nagiosxi/


real    11m19.022s
user    7m51.997s
sys     2m22.187s
Be sure to check out our Knowledgebase for helpful articles and solutions!
User avatar
eloyd
Cool Title Here
Posts: 2129
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by eloyd »

Thanks for checking. This is one of our churn VM servers we use to create boxes for customer development work. Never had problems with it before, and at this point, this machine was the only VM running on the server. No proxy, no other errors other than one recv timeout (and successful retry) downloading something from some repo.

install.log is not currently available as snapshot was taken of the broken state and then restored to previous version to do the 5.6.10 install on a clean machine. Timer started on this one about 5 minutes ago so hopefully it will be the normal 10-15 minutes and not 2-3 hours.

Will update with results.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoydI'm a Nagios Fanatic!
benjaminsmith
Posts: 5324
Joined: Wed Aug 22, 2018 4:39 pm
Location: saint paul

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by benjaminsmith »

Hi @eloyd,
will update with results.
Sounds good.
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.

Be sure to check out our Knowledgebase for helpful articles and solutions!
User avatar
eloyd
Cool Title Here
Posts: 2129
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by eloyd »

An hour and 20 minutes later and the install is still going. It's like the compiles are taking forever. We have work to do, so I can't afford to start over and troubleshoot this too much; need to get a working box going for this customer.

Maybe next week I'll have time to come back and diagnose what issues are. Just wanted to make sure I wasn't missing something with the 3.6.9 installer.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoydI'm a Nagios Fanatic!
User avatar
lmiltchev
Former Nagios Staff
Posts: 13587
Joined: Mon May 23, 2011 12:15 pm

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by lmiltchev »

We haven't been able to recreate the issue in-house. There are no other reports about the 5.6.9 installer taking too long to run. I suspect that there is something wrong with the system you are trying to install Nagios XI on. It is hard to say without looking at least at the install.log. Having said that, I am going to keep the thread open just in case. Please let us know if you find any additional information. Have you tried installing 5.6.10? Are you having the same issues with it? Have you tried installing 5.6.9 or 5.6.10 on a different system? Any details/feedback would be welcome. Thanks!
Be sure to check out our Knowledgebase for helpful articles and solutions!
User avatar
eloyd
Cool Title Here
Posts: 2129
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by eloyd »

So we installed it on our usual virtualization server (that's the first one) then we reinstalled the virtualization server OS and tried again. Then we did it on a virtualbox on one of our desktops, one of our laptops, and even my home server. All of which have had Nagios XI installed on them before without issue. Suddenly, for some reason, this install combination (CentOS 7 from minimal DVD plus Nagios XI any-version) is taking 3+ hours to install. We even downloaded latest CentOS 7 minimal DVD.

Finally gave up and turned up an AWS CentOS 7 box and did it there. 12 minute install, like normal.

Starting to think something's changed with the minimal install from CentOS for some reason and may investigate. May not. Preliminary examinations indicate that the problem is during compiles. Like it's not recognizing multiple CPUs. Regardless, it's safe to say that this is not a Nagios specific issue and can be closed.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoydI'm a Nagios Fanatic!
User avatar
lmiltchev
Former Nagios Staff
Posts: 13587
Joined: Mon May 23, 2011 12:15 pm

Re: 3 hours to intall 5.6.9 on 8 cores/32GB???

Post by lmiltchev »

I tried another install of Nagios XI 5.6.9 on CentOS 7 (minimal) VM with the specs below:

Code: Select all

[root@TEST_XI_CentOS_7 nagiosxi]# lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                8
On-line CPU(s) list:   0-7
Thread(s) per core:    1
Core(s) per socket:    1
Socket(s):             8
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 44
Model name:            Intel(R) Xeon(R) CPU           X5660  @ 2.80GHz
Stepping:              2
CPU MHz:               2793.000
BogoMIPS:              5586.00
Hypervisor vendor:     VMware
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              12288K
NUMA node0 CPU(s):     0-7
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 popcnt aes hypervisor lahf_lm dtherm ida arat
[root@TEST_XI_CentOS_7 nagiosxi]# free -h
              total        used        free      shared  buff/cache   available
Mem:            31G        288M         30G        8.8M        363M         30G
and it took about 12 minutes to complete. FYI.

I will be closing the topic now, but if you have any new findings/info, feel free to start a new topic (or PM me and ask me to unlock the thread). Thanks!
Be sure to check out our Knowledgebase for helpful articles and solutions!
Locked