Nagios log server upgrade fails with website doesn't work

[thanigaivel.a]

kindly find the output below.

[root@usa0300lv6332 log]# ls -al /var/www/html/nagioslogserver/system/core/CodeIgniter.php
-rw------- 1 root root 16111 Feb 21 08:14 /var/www/html/nagioslogserver/system/core/CodeIgniter.php
[root@usa0300lv6332 log]# ls -al /var/www/html/nagioslogserver/system/
total 24
drwx------ 8 root root 122 Feb 21 08:14 .
drwxr-xr-x 5 root root 63 Feb 21 08:14 ..
drwx------ 3 root root 4096 Feb 21 08:14 core
drwx------ 3 root root 4096 Feb 21 08:14 database
drwx------ 2 root root 38 Feb 21 08:14 fonts
drwx------ 2 root root 4096 Feb 21 08:14 helpers
-rw------- 1 root root 117 Feb 21 08:14 .htaccess
-rw------- 1 root root 131 Feb 21 08:14 index.html
drwx------ 3 root root 37 Feb 21 08:14 language
drwx------ 5 root root 4096 Feb 21 08:14 libraries
[root@usa0300lv6332 log]# ls -al /var/www/html/nagioslogserver/
total 12
drwxr-xr-x 5 root root 63 Feb 21 08:14 .
drwxr-xr-x 4 root root 90 Oct 3 09:37 ..
drwxr-xr-x 17 root root 4096 Feb 21 08:15 application
-rw-r--r-- 1 root root 12 Feb 21 08:14 lsversion
drwx------ 8 root root 122 Feb 21 08:14 system
drwxr-xr-x 9 root root 4096 Feb 21 08:15 www
[root@usa0300lv6332 log]#

[thanigaivel.a]

Also, provide me the outlook, that when we can expect to fix this issue. Since the web portal is down for more than 2 days.

[scottwilkerson]

the permissions on this directory structure has been changed.

Run the following:

Code: Select all

for dir in application/cache application/config www/media www/scripts application/dashboards; do
	chgrp -R "apache" "/var/www/html/nagioslogserver/$dir"
	chmod -R ug+rwx "/var/www/html/nagioslogserver/$dir"
done

chown -R nagios.nagios "/usr/local/nagioslogserver"
chmod -R 0775 "/usr/local/nagioslogserver"
chmod -R 0775 "/usr/local/nagioslogserver/var"
chmod 0554 /usr/local/nagioslogserver/scripts/*

Also, provide me the outlook, that when we can expect to fix this issue. Since the web portal is down for more than 2 days.

As soon as we fix all of the permissions that were changed on the system, I am guessing it will be back. I would talk to engineers that changed permissions and make sure they do not do that again.

[thanigaivel.a]

Had ran the script which you provided and rebooted the server also, however still the web portal is not working.

O/P after script:

[root@usa0300lv6332 ~]# ls -al /var/www/html/nagioslogserver/system/core/CodeIgniter.php
-rw------- 1 root root 16111 Feb 21 08:14 /var/www/html/nagioslogserver/system/core/CodeIgniter.php
[root@usa0300lv6332 ~]# ls -al /var/www/html/nagioslogserver/system/
total 24
drwx------ 8 root root 122 Feb 21 08:14 .
drwxr-xr-x 5 root root 63 Feb 21 08:14 ..
drwx------ 3 root root 4096 Feb 21 08:14 core
drwx------ 3 root root 4096 Feb 21 08:14 database
drwx------ 2 root root 38 Feb 21 08:14 fonts
drwx------ 2 root root 4096 Feb 21 08:14 helpers
-rw------- 1 root root 117 Feb 21 08:14 .htaccess
-rw------- 1 root root 131 Feb 21 08:14 index.html
drwx------ 3 root root 37 Feb 21 08:14 language
drwx------ 5 root root 4096 Feb 21 08:14 libraries
[root@usa0300lv6332 ~]# ls -al /var/www/html/nagioslogserver
total 12
drwxr-xr-x 5 root root 63 Feb 21 08:14 .
drwxr-xr-x 4 root root 90 Oct 3 09:37 ..
drwxr-xr-x 17 root root 4096 Feb 21 08:15 application
-rw-r--r-- 1 root root 12 Feb 21 08:14 lsversion
drwx------ 8 root root 122 Feb 21 08:14 system
drwxr-xr-x 9 root root 4096 Feb 21 08:15 www
[root@usa0300lv6332 ~]#


[root@usa0300lv6332 ~]# wget https://usa0300lv6332.sdsp.mc.xerox.com ... logserver/
--2018-02-28 03:58:55-- https://usa0300lv6332.sdsp.mc.xerox.com ... logserver/
Resolving www2.mc.xerox.com (www2.mc.xerox.com)... 13.131.1.241
Connecting to www2.mc.xerox.com (www2.mc.xerox.com)|13.131.1.241|:8000... connected.
Proxy request sent, awaiting response... 500 Internal Server Error
2018-02-28 03:58:55 ERROR 500: Internal Server Error.

[root@usa0300lv6332 ~]#

[thanigaivel.a]

Kindly find the ssl_error_log, had noticed some error in it.

[Wed Feb 28 03:42:24.389072 2018] [:error] [pid 1771] [client 13.131.1.242:55702] PHP Fatal error: require_once(): Failed opening required '/var/www/html/nagioslogserver/system/core/CodeIgniter.php' (include_path='.:/usr/share/pear:/usr/share/php') in /var/www/html/nagioslogserver/www/index.php on line 315
[Wed Feb 28 03:42:46.092095 2018] [:error] [pid 1771] [client 10.15.23.164:65098] PHP Warning: require_once(/var/www/html/nagioslogserver/system/core/CodeIgniter.php): failed to open stream: Permission denied in /var/www/html/nagioslogserver/www/index.php on line 315

Also, attached httpd logs

[scottwilkerson]

it does not appear that the top section if the commands I gave you ran.

One more permission change

Code: Select all

chmod -R ug+rwx "/var/www/html/nagioslogserver/system"
chmod -R o+r "/var/www/html/nagioslogserver/system"

If it still does not work, please send results of the following

Please send results of the following commands

Code: Select all

ls -al /var/www/html/nagioslogserver/system/core/CodeIgniter.php

[thanigaivel.a]

[root@usa0300lv6332 ~]# ls -al /var/www/html/nagioslogserver/system/core/CodeIgniter.php
-rwxrwxr-- 1 root root 16111 Feb 21 08:14 /var/www/html/nagioslogserver/system/core/CodeIgniter.php

also attached httpd logs and codelgniter.php full content

[scottwilkerson]

what error are you seeing when you access the server now?

After you ran those commands you should not see /var/www/html/nagioslogserver/system/core/CodeIgniter.php error any longer.

[thanigaivel.a]

copied both ssl_error_log and error_log, still issue persists.

Is it possible to support via cisco webex ?

[root@usa0300lv6332 ~]# less /var/log/httpd/ssl_error_log

[Thu Mar 01 14:00:13.400330 2018] [:error] [pid 12997] [client 10.15.23.164:50775] PHP Warning: require_once(/var/www/html/nagioslogserver/system/core/CodeIgniter.php): failed to open stream: Permission denied in /var/www/html/nagioslogserver/www/index.php on line 315
[Thu Mar 01 14:00:13.400399 2018] [:error] [pid 12997] [client 10.15.23.164:50775] PHP Fatal error: require_once(): Failed opening required '/var/www/html/nagioslogserver/system/core/CodeIgniter.php' (include_path='.:/usr/share/pear:/usr/share/php') in /var/www/html/nagioslogserver/www/index.php on line 315
[Thu Mar 01 14:00:14.486672 2018] [:error] [pid 12996] [client 10.15.23.164:50774] PHP Warning: require_once(/var/www/html/nagioslogserver/system/core/CodeIgniter.php): failed to open stream: Permission denied in /var/www/html/nagioslogserver/www/index.php on line 315
[Thu Mar 01 14:00:14.486777 2018] [:error] [pid 12996] [client 10.15.23.164:50774] PHP Fatal error: require_once(): Failed opening required '/var/www/html/nagioslogserver/system/core/CodeIgniter.php' (include_path='.:/usr/share/pear:/usr/share/php') in /var/www/html/nagioslogserver/www/index.php on line 315
Waiting for data... (interrupt to abort)


#less /var/log/httpd/error_log

[Thu Mar 01 13:58:18.755118 2018] [auth_digest:notice] [pid 11907] AH01757: generating secret for digest authentication ...
[Thu Mar 01 13:58:18.756114 2018] [lbmethod_heartbeat:notice] [pid 11907] AH02282: No slotmem from mod_heartmonitor
[Thu Mar 01 13:58:18.782186 2018] [mpm_prefork:notice] [pid 11907] AH00163: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips PHP/5.4.16 configured -- resuming normal operations
[Thu Mar 01 13:58:18.782228 2018] [core:notice] [pid 11907] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'
[Thu Mar 01 13:59:49.306844 2018] [mpm_prefork:notice] [pid 11907] AH00170: caught SIGWINCH, shutting down gracefully
[Thu Mar 01 13:59:50.430211 2018] [suexec:notice] [pid 12992] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 10.15.17.27. Set the 'ServerName' directive globally to suppress this message
[Thu Mar 01 13:59:50.479575 2018] [auth_digest:notice] [pid 12992] AH01757: generating secret for digest authentication ...
[Thu Mar 01 13:59:50.480461 2018] [lbmethod_heartbeat:notice] [pid 12992] AH02282: No slotmem from mod_heartmonitor
[Thu Mar 01 13:59:50.502335 2018] [mpm_prefork:notice] [pid 12992] AH00163: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips PHP/5.4.16 configured -- resuming normal operations
[Thu Mar 01 13:59:50.502384 2018] [core:notice] [pid 12992] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'
Waiting for data... (interrupt to abort)

[scottwilkerson]

PM sent