Page 1 of 1

XI UI stuck on "Update in progress." as others

Posted: Wed Sep 26, 2018 12:27 pm
by stefanw
Hi everyone. Long-time reader, first-time poster. :)

I'm having the same issue as I've read many others have had. The XI web UI "Check for Updates" is stuck on "Update in progress. Please wait. Update may take a few minutes."
However, I've exhaustively (I believe) dug through this forum and tried everything related to this issue with no success. I am stumped!!

Rough outline of steps leading up to this point:
- previous XI was version 5.4.x (I forget exactly which)
- upgrade to 5.5.4 attempted via https://FQDN/nagiosxi/admin/updates.php
- did not complete successfully, but UI still saying "Update in progress. Please wait. Update may take a few minutes."
- I realized gearman was probably getting in the way
- disabled gearman by removing "broker_module" line from /usr/local/nagios/etc/nagios.cfg and stopping both gearman services
- followed manual XI upgrade process - success! It's now 5.5.4 and Core 4.4.2
- UI still saying "Update in progress. Please wait. Update may take a few minutes."

I have followed this topic to the letter:
https://support.nagios.com/forum/viewto ... 16&t=44769
but there's been no change.

Here's some basics to start off:

Code: Select all

# grep xiver /usr/local/nagiosxi/var/xi-sys.cfg
xiver='5.5.4'
# /usr/local/nagios/bin/nagios --version | grep "Core 4"
Nagios Core 4.4.2
# echo "select * from xi_commands \G;" | mysql -uroot -pnagiosxi nagiosxi
*************************** 1. row ***************************
        command_id: 19112
          group_id: 0
      submitter_id: 61
    beneficiary_id: 0
           command: 1120
   submission_time: 2018-08-16 11:48:27
        event_time: 2018-08-16 11:48:27
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-08-16 11:48:27
       status_code: 1
       result_code: 0
      command_data: a:1:{i:0;s:61:"https://assets.nagios.com/downloads/nagiosxi/xi-latest.tar.gz";}
            result: NULL
*************************** 2. row ***************************
        command_id: 19363
          group_id: 0
      submitter_id: 134
    beneficiary_id: 0
           command: 1100
   submission_time: 2018-09-26 09:50:17
        event_time: 2018-09-26 09:50:17
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-09-26 09:50:17
       status_code: 2
       result_code: 0
      command_data: 
            result: 
*************************** 3. row ***************************
        command_id: 19364
          group_id: 0
      submitter_id: 61
    beneficiary_id: 0
           command: 1100
   submission_time: 2018-09-26 10:02:29
        event_time: 2018-09-26 10:02:29
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-09-26 10:02:29
       status_code: 2
       result_code: 0
      command_data: 
            result: 
*************************** 4. row ***************************
        command_id: 19365
          group_id: 0
      submitter_id: 61
    beneficiary_id: 0
           command: 1100
   submission_time: 2018-09-26 11:04:15
        event_time: 2018-09-26 11:04:15
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-09-26 11:04:15
       status_code: 2
       result_code: 0
      command_data: 
            result: 
*************************** 5. row ***************************
        command_id: 19366
          group_id: 0
      submitter_id: 61
    beneficiary_id: 0
           command: 1114
   submission_time: 2018-09-26 11:49:12
        event_time: 2018-09-26 11:49:12
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-09-26 11:49:12
       status_code: 2
       result_code: 0
      command_data: 1537972923
            result: 
*************************** 6. row ***************************
        command_id: 19367
          group_id: 0
      submitter_id: 61
    beneficiary_id: 0
           command: 1117
   submission_time: 2018-09-26 11:49:22
        event_time: 2018-09-26 11:49:21
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-09-26 11:49:22
       status_code: 1
       result_code: 0
      command_data: 
            result: NULL
*************************** 7. row ***************************
        command_id: 19368
          group_id: 0
      submitter_id: 61
    beneficiary_id: 0
           command: 111
   submission_time: 2018-09-26 12:38:05
        event_time: 2018-09-26 12:38:05
    frequency_type: 0
   frequency_units: 0
frequency_interval: 0
   processing_time: 2018-09-26 12:38:05
       status_code: 2
       result_code: 0
      command_data: a:1:{i:0;s:0:"";}
            result: NPCD started.
# echo "select * from xi_options where name = 'last_update_status' OR name = 'last_update_message';" | mysql -uroot -pnagiosxi nagiosxi
# echo 'UPDATE xi_options SET value=1 WHERE name="last_update_check_succeeded";' | mysql -u root -pnagiosxi nagiosxi
# service httpd restart                                                                                            
Stopping httpd:                                            [  OK  ]
Starting httpd:                                            [  OK  ]
# echo 'select * from  xi_options  WHERE name="last_update_check_succeeded";' |mysql -t -u root -pnagiosxi nagiosxi
+-----------+-----------------------------+-------+
| option_id | name                        | value |
+-----------+-----------------------------+-------+
|        16 | last_update_check_succeeded | 1     |
+-----------+-----------------------------+-------+
# echo 'desc  xi_options;' |mysql -t -u root -pnagiosxi nagiosxi
+-----------+--------------+------+-----+---------+----------------+
| Field     | Type         | Null | Key | Default | Extra          |
+-----------+--------------+------+-----+---------+----------------+
| option_id | int(11)      | NO   | PRI | NULL    | auto_increment |
| name      | varchar(128) | NO   | MUL | NULL    |                |
| value     | text         | YES  |     | NULL    |                |
+-----------+--------------+------+-----+---------+----------------+
# uname -a
Linux FQDN 2.6.32-754.3.5.el6.x86_64 #1 SMP Tue Aug 14 20:46:41 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
# lsb_release -a
LSB Version:	:base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch
Distributor ID:	CentOS
Description:	CentOS release 6.10 (Final)
Release:	6.10
Codename:	Final

Also in case it helps, "yum repolist" edited for brevity:

Code: Select all

repo id        repo name                                       status
base           CentOS-6 - Base                                  6713
cr             CentOS-6 - CR                                       0
epel           Extra Packages for Enterprise Linux 6 - x86_64  12520
extras         CentOS-6 - Extras                                  33
nagios-base    Nagios                                            173
nagiosxi-deps  Nagios XI Dependencies                             33
pdagent        PDAgent                                            18
updates        CentOS-6 - Updates                                125


I have also:
- checked /usr/local/nagiosxi/tmp/upgrade.log - it's zero bytes
- gone to https://FQDN/nagiosxi/admin/updates.php?acknowledge=1 but still no change
- verified all patches are applied ("yum update")
- rebooted
- run /usr/local/nagiosxi/scripts/repair_databases.sh - no errors found

Let me know if/when you need it and I will PM the 'select * from xi_options;'

Thanks in advance for helping with this mystery!

Re: XI UI stuck on "Update in progress." as others

Posted: Wed Sep 26, 2018 2:28 pm
by lmiltchev
Do you see the same issue when you use a different browser? Have you tried logging out, clearing the browsers cache, then logging in again? What is the output of the following command?

Code: Select all

cat /usr/local/nagiosxi/var/xiversion
Go to Admin > System Information > Check For Updates, and show us a screenshot of this page.

Also, try running the following commands from the CLI to see if this is going to fix the issue:

Code: Select all

echo "UPDATE xi_options SET value = 'yes' WHERE name = 'last_update_acknowledged';" | mysql -t -u root -pnagiosxi nagiosxi
echo "DELETE FROM xi_commands WHERE command = 1120;" | mysql -t -u root -pnagiosxi nagiosxi 

Re: XI UI stuck on "Update in progress." as others

Posted: Wed Sep 26, 2018 3:02 pm
by stefanw
Thanks! Good news - the second of those two MySQL operations did the trick.

tl;dr: the magic command was:

Code: Select all

echo "DELETE FROM xi_commands WHERE command = 1120;" | mysql -t -u root -pnagiosxi nagiosxi
followed by

Code: Select all

service httpd restart
OK to lock this thread.



In case it helps other people on this forum, here's all the answers / info for what you asked:

Yes indeed, same issue seen in both Chrome 69.0.3497.100 and Safari 12.0 (13606.2.11)

Yes, I have logged out, cleared cache, logged back in - no change.

Code: Select all

# cat /usr/local/nagiosxi/var/xiversion
###################################
# DO NOT DELETE THIS FILE!
# Nagios XI version information
###################################
full=5.5.4
major=5
minor=5.4
releasedate=2018-09-20
release=5504
Screen Shot 2018-09-26 at 3.48.03 PM.png

Code: Select all

# echo "UPDATE xi_options SET value = 'yes' WHERE name = 'last_update_acknowledged';" | mysql -t -u root -pnagiosxi nagiosxi
# service httpd restart
Stopping httpd:                                            [  OK  ]
Starting httpd:                                            [  OK  ]
# echo "DELETE FROM xi_commands WHERE command = 1120;" | mysql -t -u root -pnagiosxi nagiosxi
# service httpd restart
Stopping httpd:                                            [  OK  ]
Starting httpd:                                            [  OK  ]
Again, it was the second of those two (the one with "DELETE FROM") which finally fixed this issue.

Thanks!

Re: XI UI stuck on "Update in progress." as others

Posted: Wed Sep 26, 2018 3:07 pm
by lmiltchev
I am glad your issue has been resolved! Thanks for the feedback! I am locking this topic.