Avail CGI stuck

[arnab.roy]

Hi,

We are having some serious issue running reports every time we click on the reports tab on XI the page just gets stuck with top showing avail.cgi stuck at 100% cpu and nothing happens. Cant see any errors in apache. If I run the availability report directly from nagios core it works just fine.

Please help asap.

Many Thanks
Arnab

[tmcdonald]

What version of XI are you running? Are there any entries in /var/log/httpd/error_log when you visit the page?

[abrist]

Are your db tables crashed?

Code: Select all

tail -25 /var/log/mysqld.log

How big is your nagios.log file?

Code: Select all

ls -lah /usr/local/nagios/var/nagios.log

How big are your db tables:

Code: Select all

ls -lahS /var/lib/mysql/nagios

[arnab.roy]

Hi ,

XI version is 2014 R1.3 ,

The outputs

ls -lah /usr/local/nagios/var/nagios.log
-rw-r--r-- 1 nagios nagios 56M Aug 7 17:06 /usr/local/nagios/var/nagios.log

ls -lahS /var/lib/mysql/nagios
total 1.5G
-rw-rw---- 1 mysql mysql 479M Aug 7 17:25 nagios_logentries.MYD
-rw-rw---- 1 mysql mysql 432M Aug 7 17:25 nagios_logentries.MYI
-rw-rw---- 1 mysql mysql 258M Aug 7 17:25 nagios_externalcommands.MYD
-rw-rw---- 1 mysql mysql 256M Aug 7 16:53 nagios_statehistory.MYD
-rw-rw---- 1 mysql mysql 31M Aug 7 16:57 nagios_statehistory.MYI
-rw-rw---- 1 mysql mysql 8.6M Aug 7 17:25 nagios_externalcommands.MYI
-rw-rw---- 1 mysql mysql 3.0M Aug 7 17:10 nagios_notifications.MYD
-rw-rw---- 1 mysql mysql 1.6M Aug 7 16:44 nagios_commenthistory.MYD
-rw-rw---- 1 mysql mysql 1.4M Aug 7 17:12 nagios_contactnotifications.MYI
-rw-rw---- 1 mysql mysql 1.2M Aug 7 17:12 nagios_notifications.MYI
-rw-rw---- 1 mysql mysql 1.2M Aug 7 17:12 nagios_contactnotificationmethods.MYI
-rw-rw---- 1 mysql mysql 939K Aug 7 16:44 nagios_flappinghistory.MYD
-rw-rw---- 1 mysql mysql 864K Aug 7 17:10 nagios_contactnotificationmethods.MYD
-rw-rw---- 1 mysql mysql 766K Aug 7 17:10 nagios_contactnotifications.MYD
-rw-rw---- 1 mysql mysql 465K Aug 7 17:25 nagios_servicestatus.MYD
-rw-rw---- 1 mysql mysql 387K Aug 7 17:25 nagios_servicestatus.MYI
-rw-rw---- 1 mysql mysql 265K Aug 7 16:46 nagios_services.MYD
-rw-rw---- 1 mysql mysql 155K Aug 7 16:48 nagios_commenthistory.MYI
-rw-rw---- 1 mysql mysql 150K Aug 7 16:44 nagios_flappinghistory.MYI
-rw-rw---- 1 mysql mysql 113K Aug 7 16:46 nagios_objects.MYI
-rw-rw---- 1 mysql mysql 107K Aug 7 16:46 nagios_objects.MYD
-rw-rw---- 1 mysql mysql 82K Aug 7 16:48 nagios_service_contactgroups.MYI
-rw-rw---- 1 mysql mysql 68K Aug 7 16:46 nagios_services.MYI
-rw-rw---- 1 mysql mysql 51K Aug 7 16:44 nagios_acknowledgements.MYD
-rw-rw---- 1 mysql mysql 49K Aug 7 17:25 nagios_conninfo.MYD
-rw-rw---- 1 mysql mysql 49K Aug 7 16:46 nagios_service_contactgroups.MYD
-rw-rw---- 1 mysql mysql 42K Aug 7 16:48 nagios_customvariables.MYI
-rw-rw----. 1 mysql mysql 40K Aug 1 2012 nagios_servicestatus.frm
-rw-rw----. 1 mysql mysql 40K Aug 1 2012 nagios_hoststatus.frm
-rw-rw---- 1 mysql mysql 38K Aug 7 17:25 nagios_customvariablestatus.MYI
-rw-rw---- 1 mysql mysql 38K Aug 7 17:25 nagios_hoststatus.MYD
-rw-rw---- 1 mysql mysql 36K Aug 7 17:25 nagios_customvariablestatus.MYD
-rw-rw----. 1 mysql mysql 34K Aug 1 2012 nagios_hostchecks.frm
-rw-rw----. 1 mysql mysql 34K Aug 1 2012 nagios_servicechecks.frm
-rw-rw----. 1 mysql mysql 34K Aug 1 2012 nagios_eventhandlers.frm
-rw-rw---- 1 mysql mysql 33K Oct 23 2012 nagios_statehistory.frm
-rw-rw---- 1 mysql mysql 33K Jul 25 12:16 nagios_notifications.frm
-rw-rw----. 1 mysql mysql 33K Aug 1 2012 nagios_systemcommands.frm
-rw-rw---- 1 mysql mysql 32K Aug 7 17:25 nagios_hoststatus.MYI
-rw-rw---- 1 mysql mysql 30K Aug 7 16:46 nagios_customvariables.MYD
-rw-rw---- 1 mysql mysql 29K Aug 7 16:46 nagios_processevents.MYD
-rw-rw---- 1 mysql mysql 27K Aug 7 17:25 nagios_systemcommands.MYD
-rw-rw---- 1 mysql mysql 25K Aug 7 16:44 nagios_downtimehistory.MYD
-rw-rw---- 1 mysql mysql 22K Aug 7 16:46 nagios_commands.MYD
-rw-rw---- 1 mysql mysql 21K Aug 7 16:46 nagios_hosts.MYD
-rw-rw---- 1 mysql mysql 18K Aug 7 16:44 nagios_acknowledgements.MYI
-rw-rw---- 1 mysql mysql 14K Aug 7 16:46 nagios_comments.MYD
drwx------. 2 mysql mysql 12K Aug 7 16:45 .
-rw-rw---- 1 mysql mysql 12K Aug 7 17:25 nagios_systemcommands.MYI
-rw-rw---- 1 mysql mysql 12K Jul 25 12:16 nagios_hosts.frm
-rw-rw---- 1 mysql mysql 12K Jul 25 12:16 nagios_services.frm
-rw-rw---- 1 mysql mysql 10K Aug 7 16:44 nagios_downtimehistory.MYI
-rw-rw---- 1 mysql mysql 10K Aug 7 16:48 nagios_host_contactgroups.MYI
-rw-rw---- 1 mysql mysql 10K Aug 7 16:48 nagios_hostgroup_members.MYI
-rw-rw---- 1 mysql mysql 10K Aug 7 16:46 nagios_hosts.MYI
-rw-rw----. 1 mysql mysql 10K Aug 1 2012 nagios_programstatus.frm
-rw-rw---- 1 mysql mysql 9.8K Jul 25 12:16 nagios_contacts.frm
-rw-rw----. 1 mysql mysql 9.3K Aug 1 2012 nagios_downtimehistory.frm
-rw-rw----. 1 mysql mysql 9.2K Aug 1 2012 nagios_commenthistory.frm
-rw-rw----. 1 mysql mysql 9.2K Aug 1 2012 nagios_scheduleddowntime.frm
-rw-rw----. 1 mysql mysql 9.1K Aug 1 2012 nagios_conninfo.frm
-rw-rw----. 1 mysql mysql 9.1K Aug 1 2012 nagios_contactstatus.frm
-rw-rw----. 1 mysql mysql 9.1K Aug 1 2012 nagios_comments.frm
-rw-rw----. 1 mysql mysql 9.1K Aug 1 2012 nagios_serviceescalations.frm
-rw-rw----. 1 mysql mysql 9.0K Aug 1 2012 nagios_servicedependencies.frm
-rw-rw----. 1 mysql mysql 9.0K Aug 1 2012 nagios_flappinghistory.frm
-rw-rw----. 1 mysql mysql 9.0K Aug 1 2012 nagios_hostescalations.frm
-rw-rw----. 1 mysql mysql 8.9K Aug 1 2012 nagios_hostdependencies.frm
-rw-rw---- 1 mysql mysql 8.9K Oct 23 2012 nagios_timedevents.frm
-rw-rw---- 1 mysql mysql 8.9K Jul 25 12:16 nagios_acknowledgements.frm
-rw-rw---- 1 mysql mysql 8.8K Jul 25 12:16 nagios_contactnotificationmethods.frm
-rw-rw---- 1 mysql mysql 8.8K Jul 25 12:17 nagios_logentries.frm
-rw-rw----. 1 mysql mysql 8.8K Aug 1 2012 nagios_processevents.frm
-rw-rw---- 1 mysql mysql 8.8K Jul 25 12:16 nagios_contactnotifications.frm
-rw-rw---- 1 mysql mysql 8.8K Oct 23 2012 nagios_timedeventqueue.frm
-rw-rw----. 1 mysql mysql 8.7K Aug 1 2012 nagios_customvariablestatus.frm
-rw-rw---- 1 mysql mysql 8.7K Aug 7 16:46 nagios_configfilevariables.MYD
-rw-rw----. 1 mysql mysql 8.7K Aug 1 2012 nagios_contact_notificationcommands.frm
-rw-rw----. 1 mysql mysql 8.7K Aug 1 2012 nagios_customvariables.frm
-rw-rw----. 1 mysql mysql 8.7K Aug 1 2012 nagios_externalcommands.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_timeperiod_timeranges.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_serviceescalation_contactgroups.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_hostescalation_contactgroups.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_serviceescalation_contacts.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_contactgroups.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_servicegroups.frm
-rw-rw---- 1 mysql mysql 8.6K Oct 23 2012 nagios_objects.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_configfilevariables.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_contact_addresses.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_timeperiods.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_hostescalation_contacts.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_hostgroups.frm
-rw-rw---- 1 mysql mysql 8.6K Jul 25 12:16 nagios_service_parentservices.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_service_contactgroups.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_contactgroup_members.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_servicegroup_members.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_commands.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_host_contactgroups.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_host_parenthosts.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_hostgroup_members.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_service_contacts.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_configfiles.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_host_contacts.frm
-rw-rw----. 1 mysql mysql 8.6K Aug 1 2012 nagios_runtimevariables.frm
-rw-rw----. 1 mysql mysql 8.5K Aug 1 2012 nagios_instances.frm
-rw-rw----. 1 mysql mysql 8.4K Aug 1 2012 nagios_dbversion.frm
-rw-rw---- 1 mysql mysql 8.0K Aug 7 16:48 nagios_commands.MYI
-rw-rw---- 1 mysql mysql 8.0K Aug 7 16:48 nagios_comments.MYI
-rw-rw---- 1 mysql mysql 8.0K Aug 7 17:25 nagios_conninfo.MYI
-rw-rw---- 1 mysql mysql 8.0K Aug 7 16:48 nagios_processevents.MYI
-rw-rw---- 1 mysql mysql 7.0K Aug 7 16:48 nagios_host_parenthosts.MYI
-rw-rw---- 1 mysql mysql 5.0K Aug 7 16:48 nagios_configfiles.MYI
-rw-rw---- 1 mysql mysql 5.0K Aug 7 16:48 nagios_contact_notificationcommands.MYI
-rw-rw---- 1 mysql mysql 5.0K Aug 7 16:48 nagios_service_contacts.MYI
-rw-rw---- 1 mysql mysql 5.0K Aug 7 16:48 nagios_timeperiod_timeranges.MYI
drwxr-xr-x. 8 mysql mysql 4.0K Aug 7 16:46 ..
-rw-rw---- 1 mysql mysql 4.0K Aug 7 16:48 nagios_configfilevariables.MYI
-rw-rw---- 1 mysql mysql 3.3K Aug 7 16:46 nagios_host_contactgroups.MYD
-rw-rw---- 1 mysql mysql 3.2K Aug 7 16:46 nagios_hostgroup_members.MYD
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_contactgroup_members.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_contactgroups.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_contacts.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_contactstatus.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 17:00 nagios_eventhandlers.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_host_contacts.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_hostgroups.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 17:25 nagios_programstatus.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_runtimevariables.MYI
-rw-rw---- 1 mysql mysql 3.0K Aug 7 16:48 nagios_timeperiods.MYI
-rw-rw---- 1 mysql mysql 2.0K Aug 7 16:44 nagios_instances.MYI
-rw-rw---- 1 mysql mysql 1.8K Aug 7 16:46 nagios_host_parenthosts.MYD
-rw-rw---- 1 mysql mysql 1.6K Aug 7 17:00 nagios_eventhandlers.MYD
-rw-rw---- 1 mysql mysql 1.3K Aug 7 16:46 nagios_contact_notificationcommands.MYD
-rw-rw---- 1 mysql mysql 1.2K Aug 7 16:46 nagios_service_contacts.MYD
-rw-rw---- 1 mysql mysql 1.2K Aug 7 16:46 nagios_timeperiod_timeranges.MYD
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_contact_addresses.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_dbversion.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_hostchecks.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_hostdependencies.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_hostescalation_contactgroups.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_hostescalation_contacts.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:44 nagios_hostescalations.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_scheduleddowntime.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_servicechecks.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_servicedependencies.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_serviceescalation_contactgroups.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_serviceescalation_contacts.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_serviceescalations.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_servicegroup_members.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_servicegroups.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_service_parentservices.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_timedeventqueue.MYI
-rw-rw---- 1 mysql mysql 1.0K Aug 7 16:45 nagios_timedevents.MYI
-rw-rw---- 1 mysql mysql 812 Aug 7 16:46 nagios_runtimevariables.MYD
-rw-rw---- 1 mysql mysql 440 Aug 7 16:46 nagios_timeperiods.MYD
-rw-rw---- 1 mysql mysql 404 Aug 7 16:46 nagios_contacts.MYD
-rw-rw---- 1 mysql mysql 255 Aug 7 16:46 nagios_contactstatus.MYD
-rw-rw---- 1 mysql mysql 228 Aug 7 16:46 nagios_hostgroups.MYD
-rw-rw---- 1 mysql mysql 144 Aug 7 16:46 nagios_contactgroups.MYD
-rw-rw---- 1 mysql mysql 132 Aug 7 17:25 nagios_programstatus.MYD
-rw-rw---- 1 mysql mysql 105 Aug 7 16:46 nagios_contactgroup_members.MYD
-rw-rw---- 1 mysql mysql 90 Aug 7 16:46 nagios_host_contacts.MYD
-rw-rw----. 1 mysql mysql 61 Aug 1 2012 db.opt
-rw-rw---- 1 mysql mysql 44 Aug 7 16:46 nagios_configfiles.MYD
-rw-rw---- 1 mysql mysql 20 Aug 7 16:44 nagios_dbversion.MYD
-rw-rw---- 1 mysql mysql 20 Aug 7 16:44 nagios_instances.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:44 nagios_contact_addresses.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:44 nagios_hostchecks.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:44 nagios_hostdependencies.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:44 nagios_hostescalation_contactgroups.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:44 nagios_hostescalation_contacts.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:44 nagios_hostescalations.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_scheduleddowntime.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_servicechecks.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_servicedependencies.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_serviceescalation_contactgroups.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_serviceescalation_contacts.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_serviceescalations.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_servicegroup_members.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_servicegroups.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_service_parentservices.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_timedeventqueue.MYD
-rw-rw---- 1 mysql mysql 0 Aug 7 16:45 nagios_timedevents.MYD


No errors in https logs

[abrist]

Did you see any errors in the mysqld log?

[arnab.roy]

No errors after waiting for 10 minutes it ultimately did load the webpage

[arnab.roy]

Any further pointers ? ...The same thing loads up directly from core without any issues, there must be some issue can you guys check we don't have the same issue on another xi box which is on cents 5.x. I remember having similar issue which was ssl related earlier can you guys check

[abrist]

What php.ini limits do you have set?

Code: Select all

grep " memory_limit\|max_execution\|max_input" /etc/php.ini