Page 1 of 1

Some admin pages are blank

Posted: Tue Aug 23, 2016 12:25 pm
by burkm
Hello,

Not sure when it started, but I noticed recently that some of the administrative pages are completely blank. I verified that I'm still an admin user.

Clicking the Administration tab on the main page results in a blank page: https://calcium.colo.example.com/nagioslogserver/admin

Clicking on either of the system status icons at the top works, and I can access most admin functions from there, but two don't work: I am running NLS 1.4.2; I've tried this on both Firefox and Safari with a cleared cache.

Re: Some admin pages are blank

Posted: Tue Aug 23, 2016 12:31 pm
by mcapra
Can you show us the output of:

Code: Select all

tail -n 30 /var/log/httpd/access_log
tail -n 30 /var/log/httpd/error_log
service elasticsearch status
Be sure to sanitize these outputs for any potentially sensitive information.

Re: Some admin pages are blank

Posted: Wed Aug 24, 2016 11:41 am
by burkm
burkm@calcium:~ $ service elasticsearch status
● elasticsearch.service - LSB: This service manages the elasticsearch daemon
Loaded: loaded (/etc/rc.d/init.d/elasticsearch)
Active: active (running) since Mon 2016-08-15 16:48:17 MDT; 1 weeks 1 days ago
Docs: man:systemd-sysv-generator(8)
Process: 15030 ExecStop=/etc/rc.d/init.d/elasticsearch stop (code=exited, status=1/FAILURE)
Process: 17005 ExecStart=/etc/rc.d/init.d/elasticsearch start (code=exited, status=0/SUCCESS)
CGroup: /system.slice/elasticsearch.service
└─17025 /bin/java -Xms11949m -Xmx11949m -Djava.awt.headless=true -XX:+UseParNewGC -XX:+Us...

Aug 15 16:48:16 calcium.example.com systemd[1]: Starting LSB: This service manages the elasti.....
Aug 15 16:48:17 calcium.example.com runuser[17016]: pam_unix(runuser:session): session opened...0)
Aug 15 16:48:17 calcium.example.com runuser[17016]: pam_unix(runuser:session): session closed...os
Aug 15 16:48:17 calcium.example.com elasticsearch[17005]: Starting elasticsearch: [ OK ]
Aug 15 16:48:17 calcium.example.com systemd[1]: Started LSB: This service manages the elastic...n.
Hint: Some lines were ellipsized, use -l to show in full.


I clicked on each of the three links in succession; here's the access log:


root@calcium:~ # tail -n30 /var/log/httpd/access_log
10.30.216.27 - - [24/Aug/2016:10:19:27 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:19:27 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:20:28 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:20:28 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:21:29 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:21:29 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:22:30 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:22:30 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:23:31 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:23:31 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:24:32 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:24:32 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:24:32 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:24:32 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:25:33 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:25:33 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:26:34 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:26:34 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:27:35 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:27:35 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:28:36 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:28:36 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:29:37 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:29:37 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:30:38 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:30:38 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
127.0.0.1 - - [24/Aug/2016:10:30:55 -0600] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.6 (CentOS) OpenSSL/1.0.1e-fips PHP/5.4.16 (internal dummy connection)"
10.30.216.27 - - [24/Aug/2016:10:31:39 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:31:39 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
127.0.0.1 - - [24/Aug/2016:10:32:21 -0600] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.6 (CentOS) OpenSSL/1.0.1e-fips PHP/5.4.16 (internal dummy connection)"
10.30.216.27 - - [24/Aug/2016:10:32:40 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"
10.30.216.27 - - [24/Aug/2016:10:32:40 -0600] "POST /nagioslogserver/api/system/status HTTP/1.1" 200 95 "http://calcium.example.com/nagioslogserver/admin/system" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601.7.7"



root@calcium:~ # tail -n30 /var/log/httpd/error_log
[Sun Aug 21 03:37:01.781247 2016] [auth_digest:notice] [pid 6885] AH01757: generating secret for digest authentication ...
[Sun Aug 21 03:37:01.781793 2016] [lbmethod_heartbeat:notice] [pid 6885] AH02282: No slotmem from mod_heartmonitor
[Sun Aug 21 03:37:01.788829 2016] [mpm_prefork:notice] [pid 6885] AH00163: Apache/2.4.6 (CentOS) OpenSSL/1.0.1e-fips PHP/5.4.16 configured -- resuming normal operations
[Sun Aug 21 03:37:01.788849 2016] [core:notice] [pid 6885] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'

Re: Some admin pages are blank

Posted: Wed Aug 24, 2016 12:02 pm
by mcapra
Does restarting the elasticsearch service solve the issue?

Code: Select all

service elasticsearch restart
Can you also share the output of the following:

Code: Select all

curl 'localhost:9200/_cat/indices?v'

Re: Some admin pages are blank

Posted: Wed Aug 24, 2016 3:39 pm
by burkm
Restarting Elasticsearch has no effect.

I've attached the output you requested since it is very long.

Re: Some admin pages are blank

Posted: Wed Aug 24, 2016 3:48 pm
by rkennedy
burkm wrote:Hello,

Not sure when it started, but I noticed recently that some of the administrative pages are completely blank. I verified that I'm still an admin user.

Clicking the Administration tab on the main page results in a blank page: https://calcium.colo.example.com/nagioslogserver/admin

Clicking on either of the system status icons at the top works, and I can access most admin functions from there, but two don't work: I am running NLS 1.4.2; I've tried this on both Firefox and Safari with a cleared cache.
Let's take a step back, since you're using SSL, could you post these two?

Code: Select all

/var/log/httpd/ssl_error_log
/var/log/httpd/ssl_access_log

Re: Some admin pages are blank

Posted: Wed Aug 24, 2016 8:24 pm
by Box293
Does this KB article help resolve the issue?

https://support.nagios.com/kb/article.php?id=132

Re: Some admin pages are blank

Posted: Wed Aug 24, 2016 10:16 pm
by burkm
That fixed it! Thanks!

Re: Some admin pages are blank

Posted: Thu Aug 25, 2016 8:57 am
by mcapra
Awesome! Is it alright if we lock this thread and mark the issue as resolved?

Re: Some admin pages are blank

Posted: Thu Aug 25, 2016 10:39 am
by burkm
Yes, thanks