Page 2 of 4
Re: Your request was not processed in a timely manner...
Posted: Tue May 28, 2013 3:52 pm
by GldRush98
Code: Select all
[root@nagios ~]# tail -n 50 /var/log/cron
May 28 15:47:01 nagios crond[26031]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php > /usr/local/nagiosxi/var/nom.log 2>&1)
May 28 15:47:01 nagios crond[26033]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php > /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
May 28 15:47:01 nagios crond[26037]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php > /usr/local/nagiosxi/var/eventman.log 2>&1)
May 28 15:47:01 nagios crond[26038]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php > /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
May 28 15:47:01 nagios crond[26040]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php > /usr/local/nagiosxi/var/sysstat.log 2>&1)
May 28 15:47:01 nagios crond[26036]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php > /usr/local/nagiosxi/var/feedproc.log 2>&1)
May 28 15:48:01 nagios crond[26659]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php > /usr/local/nagiosxi/var/cleaner.log 2>&1)
May 28 15:48:01 nagios crond[26663]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php > /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
May 28 15:48:01 nagios crond[26665]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php > /usr/local/nagiosxi/var/reportengine.log 2>&1)
May 28 15:48:01 nagios crond[26667]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php > /usr/local/nagiosxi/var/nom.log 2>&1)
May 28 15:48:01 nagios crond[26669]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php > /usr/local/nagiosxi/var/feedproc.log 2>&1)
May 28 15:48:01 nagios crond[26678]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php > /usr/local/nagiosxi/var/eventman.log 2>&1)
May 28 15:48:01 nagios crond[26680]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php > /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
May 28 15:48:01 nagios crond[26682]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php > /usr/local/nagiosxi/var/sysstat.log 2>&1)
May 28 15:49:01 nagios crond[27223]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php > /usr/local/nagiosxi/var/cleaner.log 2>&1)
May 28 15:49:01 nagios crond[27224]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php > /usr/local/nagiosxi/var/nom.log 2>&1)
May 28 15:49:01 nagios crond[27227]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php > /usr/local/nagiosxi/var/eventman.log 2>&1)
May 28 15:49:01 nagios crond[27229]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php > /usr/local/nagiosxi/var/reportengine.log 2>&1)
May 28 15:49:01 nagios crond[27230]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php > /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
May 28 15:49:01 nagios crond[27231]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php > /usr/local/nagiosxi/var/sysstat.log 2>&1)
May 28 15:49:01 nagios crond[27226]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php > /usr/local/nagiosxi/var/feedproc.log 2>&1)
May 28 15:49:01 nagios crond[27233]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php > /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
May 28 15:50:01 nagios crond[27679]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/deadpool.php > /usr/local/nagiosxi/var/deadpool.log 2>&1)
May 28 15:50:01 nagios crond[27681]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php > /usr/local/nagiosxi/var/cleaner.log 2>&1)
May 28 15:50:01 nagios crond[27682]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/dbmaint.php > /usr/local/nagiosxi/var/dbmaint.log 2>&1)
May 28 15:50:01 nagios crond[27687]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php > /usr/local/nagiosxi/var/reportengine.log 2>&1)
May 28 15:50:01 nagios crond[27689]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php > /usr/local/nagiosxi/var/nom.log 2>&1)
May 28 15:50:01 nagios crond[27693]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php > /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
May 28 15:50:01 nagios crond[27694]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php > /usr/local/nagiosxi/var/sysstat.log 2>&1)
May 28 15:50:01 nagios crond[27696]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php > /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
May 28 15:50:01 nagios crond[27698]: (root) CMD (/usr/lib64/sa/sa1 1 1)
May 28 15:50:01 nagios crond[27691]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php > /usr/local/nagiosxi/var/feedproc.log 2>&1)
May 28 15:50:01 nagios crond[27692]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php > /usr/local/nagiosxi/var/eventman.log 2>&1)
May 28 15:50:02 nagios crond[27711]: (root) CMD (LANG=C LC_ALL=C /usr/bin/mrtg /etc/mrtg/mrtg.cfg --lock-file /var/lock/mrtg/mrtg_l --confcache-file /var/lib/mrtg/mrtg.ok)
May 28 15:51:01 nagios crond[28193]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php > /usr/local/nagiosxi/var/cleaner.log 2>&1)
May 28 15:51:01 nagios crond[28195]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php > /usr/local/nagiosxi/var/reportengine.log 2>&1)
May 28 15:51:01 nagios crond[28196]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php > /usr/local/nagiosxi/var/nom.log 2>&1)
May 28 15:51:01 nagios crond[28198]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php > /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
May 28 15:51:01 nagios crond[28206]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php > /usr/local/nagiosxi/var/eventman.log 2>&1)
May 28 15:51:01 nagios crond[28208]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php > /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
May 28 15:51:01 nagios crond[28209]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php > /usr/local/nagiosxi/var/sysstat.log 2>&1)
May 28 15:51:01 nagios crond[28199]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php > /usr/local/nagiosxi/var/feedproc.log 2>&1)
May 28 15:52:01 nagios crond[28875]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cleaner.php > /usr/local/nagiosxi/var/cleaner.log 2>&1)
May 28 15:52:01 nagios crond[28877]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/reportengine.php > /usr/local/nagiosxi/var/reportengine.log 2>&1)
May 28 15:52:01 nagios crond[28878]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/nom.php > /usr/local/nagiosxi/var/nom.log 2>&1)
May 28 15:52:01 nagios crond[28880]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/perfdataproc.php > /usr/local/nagiosxi/var/perfdataproc.log 2>&1)
May 28 15:52:01 nagios crond[28883]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/eventman.php > /usr/local/nagiosxi/var/eventman.log 2>&1)
May 28 15:52:01 nagios crond[28884]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/cmdsubsys.php > /usr/local/nagiosxi/var/cmdsubsys.log 2>&1)
May 28 15:52:01 nagios crond[28885]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/sysstat.php > /usr/local/nagiosxi/var/sysstat.log 2>&1)
May 28 15:52:02 nagios crond[28882]: (nagios) CMD (/usr/bin/php -q /usr/local/nagiosxi/cron/feedproc.php > /usr/local/nagiosxi/var/feedproc.log 2>&1)
[root@nagios ~]#
Re: Your request was not processed in a timely manner...
Posted: Tue May 28, 2013 4:57 pm
by abrist
GldRush98 wrote:Didn't help. Something else that's related, I've only got 3 green checks in the top right corner instead of 6 green checks.
After the reboot, are you still experiencing this problem?
Re: Your request was not processed in a timely manner...
Posted: Tue May 28, 2013 4:59 pm
by GldRush98
Yes I am
Re: Your request was not processed in a timely manner...
Posted: Wed May 29, 2013 11:59 am
by lmiltchev
This is really strange. Run the following commands and show us the output:
Code: Select all
ll /usr/local/nagiosxi/scripts
chage -l nagios
cat /etc/group | grep nag
service nagios status
service ndo2db status
service mysqld status
service postgresql status
service crond status
Re: Your request was not processed in a timely manner...
Posted: Thu May 30, 2013 1:54 pm
by GldRush98
I feel like it is worth reminding that this issue started after the update to the 2.0 release. Before then everything was working properly.
I should also note that the server forces SSL on http connections. I wonder if the backend status is trying to be checked via http instead of https and that is causing the failure? (Edit: I just read arnab.roy's posts and see he is using SSL as well... I am really thinking one of the updates in the 2.0 release broke ssl backend checking?)
It's weird because it all worked before... I doubt it's something at the system level. I believe this to be a bug in XI or one of the packages that XI relies on that was updated in the 2.0 release.
Code: Select all
[root@nagios ~]# ll /usr/local/nagiosxi/scripts
total 752
-rwxr-x--- 1 nagios nagios 2899 May 28 10:33 backup_xi.sh
-rwxr-x--- 1 nagios nagios 649 May 28 10:33 export_nagiosql.sh
-rwxr-x--- 1 nagios nagios 821 May 28 10:33 handle_nagioscore_event.php
-rwxr-x--- 1 nagios nagios 829 May 28 10:33 handle_nagioscore_notification.php
-rwxr-x--- 1 nagios nagios 429 May 28 10:33 import_nagiosql.sh
-rwxr-x--- 1 nagios nagios 149 May 28 10:33 kill_rrdtool.sh
-rw-r----- 1 nagios nagios 153 May 28 10:33 nagiosql.cookies
-rw-r----- 1 nagios nagios 272372 May 28 10:33 nagiosql_defaults.sql
-rw-r----- 1 nagios nagios 16038 Jan 25 07:57 nagiosql.delete.contact
-rwxr-x--- 1 nagios nagios 970 May 28 10:33 nagiosql_delete_contact.php
-rw-r----- 1 nagios nagios 30982 Aug 8 2012 nagiosql.delete.host
-rwxr-x--- 1 nagios nagios 2010 May 28 10:33 nagiosql_delete_host.php
-rwxr-x--- 1 nagios nagios 505 May 28 10:33 nagiosql_delete_object.sh
-rw-r----- 1 nagios nagios 36732 May 14 11:05 nagiosql.delete.service
-rwxr-x--- 1 nagios nagios 3118 May 28 10:33 nagiosql_delete_service.php
-rw-r----- 1 nagios nagios 21623 Jan 25 07:57 nagiosql.delete.timeperiod
-rwxr-x--- 1 nagios nagios 993 May 28 10:33 nagiosql_delete_timeperiod.php
-rw-r----- 1 nagios nagios 7400 May 28 10:33 nagiosql.export.additional
-rwxr-x--- 1 nagios nagios 1637 May 28 10:33 nagiosql_exportall.php
-rw-r----- 1 nagios nagios 7096 May 28 10:33 nagiosql.export.monitoring
-rwxr-x--- 1 nagios nagios 1323 May 28 10:33 nagiosql_importall.php
-rw-r----- 1 nagios nagios 30588 May 28 10:33 nagiosql.import.monitoring
-rw-r----- 1 nagios nagios 5286 May 28 10:33 nagiosql.login
-rwxr-x--- 1 nagios nagios 1847 May 28 10:33 nagiosql_login.php
-rwxr-x--- 1 nagios nagios 2246 May 28 10:33 nagiosql_snapshot.sh
-rwxr-x--- 1 nagios nagios 258 May 28 10:33 nagiosql_trim_backups.sh
-rwxr-x--- 1 nagios nagios 515 May 28 10:33 nom_create_nagioscore_checkpoint_cond.sh
-rwxr-x--- 1 nagios nagios 826 May 28 10:33 nom_create_nagioscore_checkpoint.sh
-rwxr-x--- 1 nagios nagios 632 May 28 10:33 nom_create_nagioscore_errorpoint.sh
-rwxr-x--- 1 nagios nagios 784 May 28 10:33 nom_restore_nagioscore_checkpoint.sh
-rwxr-x--- 1 nagios nagios 839 May 28 10:33 nom_restore_nagioscore_checkpoint_specific.sh
-rwxr-x--- 1 nagios nagios 2972 May 28 10:33 nom_trim_nagioscore_checkpoints.sh
-rwxr-x--- 1 nagios nagios 4592 May 28 10:33 parse_core_eventlog.php
-rwxr-x--- 1 nagios nagios 6074 May 28 10:33 patch_ndoutils.php
-rwxr-x--- 1 nagios nagios 597 May 28 10:33 reconfigure_nagios.sh
-rwxr-x--- 1 nagios nagios 1037 May 28 10:33 repairmysql.sh
-rwsr-xr-x 1 root nagios 7092 May 28 10:33 reset_config_perms
-rw-r----- 1 nagios nagios 280 May 28 10:33 reset_config_perms.c
-rwsr-xr-x 1 root nagios 1187 May 28 10:33 reset_config_perms.sh
-rwxr-x--- 1 nagios nagios 1155 May 28 10:33 reset_nagiosadmin_password.php
-rwxr-x--- 1 nagios nagios 964 May 28 10:33 restart_nagios_with_export.sh
-rwxr-x--- 1 nagios nagios 765 May 28 10:33 restore_defaults.sh
-rwxr-x--- 1 nagios nagios 5342 May 28 10:33 restore_xi.sh
-rw-r----- 1 nagios nagios 1847 May 28 10:33 send_to_auditlog.php
-rw-r----- 1 nagios nagios 2379 May 28 10:33 uninstall_xi.sh
Code: Select all
[root@nagios ~]# chage -l nagios
Last password change : Jun 05, 2012
Password expires : never
Password inactive : never
Account expires : never
Minimum number of days between password change : 0
Maximum number of days between password change : 99999
Number of days of warning before password expires : 7
Code: Select all
[root@nagios ~]# cat /etc/group | grep nag
nagios:x:500:nagios,apache
nagcmd:x:501:nagios,apache
Code: Select all
[root@nagios ~]# service nagios status
nagios (pid 2138) is running...
[root@nagios ~]# service ndo2db status
ndo2db (pid 2157) is running...
[root@nagios ~]# service mysqld status
mysqld (pid 1859) is running...
[root@nagios ~]# service postgresql status
postmaster (pid 30776 28901 25968 25790 25746 25734 25732 25305 25226 20864 12317 11291 10119 9805 9185 7893 5831 2658 2131 2130 2129 2127 1939 1561) is running...
[root@nagios ~]# service crond status
crond (pid 1993) is running...
Re: Your request was not processed in a timely manner...
Posted: Thu May 30, 2013 2:04 pm
by GldRush98
I think one of these (that I highlighed in bold) is possibly the culprit... not liking SSL perhaps? (I force SSL. Apache will reject http request that are not via https)
2012R2.0 - 05/20/2013
=====================
- Updated sourceguardian extensions to version 9 to allow support for PHP 5.4 -SW
- Updated some link references from the Legacy CCM to the New CCM -SW
- Add ability for notification templates in Admin -> Notification Management to be deleted - SW
- Added inode filesystem check to the profile.zip -SW
- Fix for php-mcrypt bug writing module.so instead of mcrypt.so in the mcrypt.ini -SW
- Upgrade ndoutils to 1.5.2 -SW
- Upgrade to Nagios Core 3.5.0 -SW
- Patched Nagios Core 3.5.0 Fixed bug #445: Adding triggered downtime for child hosts causes a SIGSEGV on restart/reload (Eric Stanley) -SW
- Patched Nagios Core 3.5.0 Fixed bug #375: Freshness expiration never reached and bug #427: freshness threshold doesn't work if it is set long (Scott Wilkerson, Eric Stanley) -SW
- Fix to support multi-digit sub-versions in components and wizards -SW
- Updated the profile component to now fetch system and apache log information - SL / AB
- Fixed bug in CCM where clicking "Remove All" left select items disabled (versions 1.6 & 1.7 affected) - MG
- Fixed CCM bug where groups couldn't select objects as members if they had the same name - MG
- Fixed bug with Nagios Mobile where host escalations was not authorizing contacts properly - MG
- Fixed MIB upload bug where if it didn't contain any TRAP or NOTIFICATION definitions it would fail -NS
- Updated CURLOPT_SSL_VERIFYHOST to 2 in load_url() since support for 1 is about to be removed in PHP 5.4 and Curl - MG
- Fixed BPI javascript bug with "Clear All" and re-enabling disabled select options - MG
- Fixed BPI bug where syncing host/servicegroups added a duplicated definition and prevented the group from being edited - MG
- Fix for object case sensitivity lookup where case sensitivity was not alway ignored - EG
- Added ability to turn off HTTPPROXYTUNNEL from proxy component -SW
- Added changes so custom logos display on reports if they are added to the custom logo component -SW
- Added v3_priv_proto for SNMP v3 in SNMP Wizard -SW
- Added ability for Quick find auto-complete to include host alias field -SW
- Fixed html entities showing up in the second column of the CCM table -NS
- Fixed bug that would perfdataproc cron to stack up processes if host set for outbound transfer was down or entered incorrectly -SW
Re: Your request was not processed in a timely manner...
Posted: Thu May 30, 2013 2:26 pm
by abrist
Rewrite directives should not effect XI is this way, as long as you followed our https/ssl documentation in full.
Re: Your request was not processed in a timely manner...
Posted: Fri May 31, 2013 9:03 am
by GldRush98
Has any headway been made on arnab.roy's support ticket? I feel that our 2 issues are one in the same.
Re: Your request was not processed in a timely manner...
Posted: Fri May 31, 2013 9:35 am
by abrist
@Gld, have you opened a ticket? If not, you should as we could move to a remote session in your case as well. We will be working more on his issue today, anyways.
Re: Your request was not processed in a timely manner...
Posted: Fri May 31, 2013 11:39 am
by GldRush98
I have not. How do I open one?
This also seems to cause the config validation to hang any time the configuration is applied. Well... it doesn't hang, because it does complete in the background, but it appears to hang in the web gui.