Nagios is running slow

[benhank]

Code: Select all

[root@lkendrwatsonp01 scripts]# cd /usr/local/nagiosxi/scripts
[root@lkendrwatsonp01 scripts]# bash -x reset_config_perms.sh 2>&1 | ts
Aug 15 15:28:02 +++ readlink -f reset_config_perms.sh
Aug 15 15:28:02 ++ dirname /usr/local/nagiosxi/scripts/reset_config_perms.sh
Aug 15 15:28:02 + BASEDIR=/usr/local/nagiosxi/scripts
Aug 15 15:28:02 + . /usr/local/nagiosxi/scripts/../var/xi-sys.cfg
Aug 15 15:28:02 ++ apachegroup=apache
Aug 15 15:28:02 ++ apacheuser=apache
Aug 15 15:28:02 ++ chownbin=/bin/chown
Aug 15 15:28:02 ++ groupaddbin=/usr/sbin/groupadd
Aug 15 15:28:02 ++ groupdelbin=/usr/sbin/groupdel
Aug 15 15:28:02 ++ htpasswdbin=/usr/bin/htpasswd
Aug 15 15:28:02 ++ httpdconfdir=/etc/httpd/conf.d
Aug 15 15:28:02 ++ httpdconf=/etc/httpd/conf/httpd.conf
Aug 15 15:28:02 ++ httpdroot=/var/www/html
Aug 15 15:28:02 ++ httpd=httpd
Aug 15 15:28:02 ++ ntpd=ntpd
Aug 15 15:28:02 ++ crond=crond
Aug 15 15:28:02 ++ mkdirbin=/bin/mkdir
Aug 15 15:28:02 ++ mrtgcfg=/etc/mrtg/mrtg.cfg
Aug 15 15:28:02 ++ mysqld=mysqld
Aug 15 15:28:02 ++ mysqlpass=nagiosxi
Aug 15 15:28:02 ++ pgsqlrootpass=postgres
Aug 15 15:28:02 ++ pgsqlpass=nagiosxi
Aug 15 15:28:02 ++ nagioscmdgroup=nagcmd
Aug 15 15:28:02 ++ nagiosgroup=nagios
Aug 15 15:28:02 ++ nagiosuser=nagios
Aug 15 15:28:02 ++ nagioswebpwd=nagiosadmin
Aug 15 15:28:02 ++ nagioswebuser=nagiosadmin
Aug 15 15:28:02 ++ phpconfd=/etc/php.d
Aug 15 15:28:02 ++ phpini=/etc/php.ini
Aug 15 15:28:02 ++ proddir=/usr/local/nagiosxi
Aug 15 15:28:02 ++ useraddbin=/usr/sbin/useradd
Aug 15 15:28:02 ++ usermodbin=/usr/sbin/usermod
Aug 15 15:28:02 ++ userdelbin=/usr/sbin/userdel
Aug 15 15:28:02 ++ mibsdir=/usr/share/snmp/mibs
Aug 15 15:28:02 ++ phpconfdcli=/etc/php.d
Aug 15 15:28:02 ++ cfg__base_url=/nagiosxi
Aug 15 15:28:02 ++ cfg__root_dir=/usr/local/nagiosxi
Aug 15 15:28:02 ++ cfg__script_dir=/usr/local/nagiosxi/scripts
Aug 15 15:28:02 ++ cfg__xidpe_dir=/usr/local/nagios/var/spool/xidpe/
Aug 15 15:28:02 ++ cfg__perfdata_spool=/usr/local/nagios/var/spool/perfdata/
Aug 15 15:28:02 ++ cfg__nom_checkpoints_dir=/usr/local/nagiosxi/nom/checkpoints/                                                                                                                                                              nagioscore/
Aug 15 15:28:02 ++ cfg__use_https=0
Aug 15 15:28:02 ++ cfg__port_number=0
Aug 15 15:28:02 ++ cfg__dbtype=
Aug 15 15:28:02 ++ cfg__dbserver=localhost
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbtype=pgsql
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbserver=
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__user=nagiosxi
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__pwd=n@gweb
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__db=nagiosxi
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__max_auditlog_age=30
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__max_commands_age=480
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__max_events_age=480
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__optimize_interval=60
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__repair_interval=0
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbtype=mysql
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbserver=172.22.3.125
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__user=nagios
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__pwd=nagios
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__db=nagios
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_externalcommands_age=7
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_logentries_age=90
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_statehistory_age=730
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_notifications_age=90
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_timedevents_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_systemcommands_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_servicechecks_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_hostchecks_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_eventhandlers_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__optimize_interval=60
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__repair_interval=0
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbtype=mysql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbserver=172.22.3.125
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__user=nagiosql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__pwd=nagiosql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__db=nagiosql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbmaint__max_logbook_age=480
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbmaint__optimize_interval=60
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbmaint__repair_interval=0
Aug 15 15:28:02 ++ cfg__db_prefix__ndoutils=nagios_
Aug 15 15:28:02 ++ cfg__db_prefix__nagiosxi=xi_
Aug 15 15:28:02 ++ cfg__db_prefix__nagiosql=tbl_
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__cgi_dir=/usr/local/nagios/sb                                                                                                                                                              in
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__import_dir=/usr/local/nagios                                                                                                                                                              /etc/import
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__plugin_dir=/usr/local/nagios                                                                                                                                                              /libexec
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__cgi_config_file=/usr/local/n                                                                                                                                                              agios/etc/cgi.cfg
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__cmd_file=/usr/local/nagios/v                                                                                                                                                              ar/rw/nagios.cmd
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__log_file=/usr/local/nagios/v                                                                                                                                                              ar/nagios.log
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__nom_checkpoint_interval=1440
Aug 15 15:28:02 ++ cfg__component_info__pnp__perfdata_dir=/usr/local/nagios/shar                                                                                                                                                              e/perfdata
Aug 15 15:28:02 ++ cfg__component_info__pnp__share_dir=/usr/local/nagios/share/p                                                                                                                                                              np
Aug 15 15:28:02 ++ cfg__component_info__pnp__direct_url=/nagios/pnp
Aug 15 15:28:02 ++ cfg__component_info__pnp__username=nagiosxi
Aug 15 15:28:02 ++ cfg__component_info__pnp__password=nagiosadmin
Aug 15 15:28:02 ++ cfg__component_info__perfdata__rrdtool_path=/usr/bin/rrdtool
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__dir=/var/www/html/nagiosql
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__direct_url=/nagiosql
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__username=nagiosxi
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__password=n@gweb
Aug 15 15:28:02 ++ cfg__component_info__nagvis__share_dir=/usr/local/nagios/shar                                                                                                                                                              e/nagvis
Aug 15 15:28:02 ++ cfg__component_info__nagvis__direct_url=/nagios/nagvis
Aug 15 15:28:02 ++ cfg__component_info__nagvis__username=nagiosadmin
Aug 15 15:28:02 ++ cfg__component_info__nagvis__password=nagiosadmin
Aug 15 15:28:02 ++ cfg__demo_mode=0
Aug 15 15:28:02 ++ cfg__dashlet_refresh_multiplier=1000
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__available_updates=86400
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__systat_eventqueuechart=5
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_monitoringstats=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__systat_monitoringperf=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_monitoringproc=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__perfdata_chart=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__network_outages=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__host_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__service_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__hostgroup_status_overview=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__hostgroup_status_grid=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__servicegroup_status_overview=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__servicegroup_status_grid=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__hostgroup_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__servicegroup_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_componentstates=7
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_serverstats=5
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__network_outages_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__network_health=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__host_status_tac_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__service_status_tac_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__feature_status_tac_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__admin_tasks=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__getting_started=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__pagetop_alert_content=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__tray_alert=30
Aug 15 15:28:02 ++ cfg__memcached_enable=0
Aug 15 15:28:02 ++ cfg__memcached_hosts__0=127.0.0.1
Aug 15 15:28:02 ++ cfg__memcached_hosts__1=192.168.1.3
Aug 15 15:28:02 ++ cfg__memcached_port=11211
Aug 15 15:28:02 ++ cfg__memcached_compress=0
Aug 15 15:28:02 ++ cfg__memcached_ttl=10
Aug 15 15:28:02 ++ cfg__use_basic_authentication=0
Aug 15 15:28:02 ++ cfg__subsystem_basic_auth_username=nagiosxi
Aug 15 15:28:02 ++ cfg__subsystem_basic_auth_password=somepassword
Aug 15 15:28:02 ++ cfg__default_language=en_US
Aug 15 15:28:02 ++ cfg__default_theme=
Aug 15 15:28:02 ++ cfg__languages__en_US=English
Aug 15 15:28:02 ++ cfg__default_instance_id=1
Aug 15 15:28:02 ++ cfg__default_result_records=100000
Aug 15 15:28:02 ++ cfg__online_help_url=http://support.nagios.com/
Aug 15 15:28:02 ++ cfg__feedback_url=http://api.nagios.com/feedback/
Aug 15 15:28:02 ++ cfg__privacy_policy_url=http://www.nagios.com/legal/privacypo                                                                                                                                                              licy/
Aug 15 15:28:02 ++ cfg__db_version=113
Aug 15 15:28:02 ++ cfg__subsystem_ticket=12345
Aug 15 15:28:02 ++ cfg__htaccess_file=/usr/local/nagiosxi/etc/htpasswd.users
Aug 15 15:28:02 ++ cfg__htpasswd_path=/usr/bin/htpasswd
Aug 15 15:28:02 ++ cfg__enable_analytics=1
Aug 15 15:28:02 ++ xiver=5.2.9
Aug 15 15:28:02 ++ distro=CentOS
Aug 15 15:28:02 ++ version=6.5
Aug 15 15:28:02 ++ ver=6
Aug 15 15:28:02 ++ architecture=x86_64
Aug 15 15:28:02 ++ dist=el6
Aug 15 15:28:02 ++ arch=x86_64
Aug 15 15:28:02 ++ php_extension_dir=/usr/lib64/php/modules
Aug 15 15:28:02 ++ cfg__base_url=/nagiosxi
Aug 15 15:28:02 ++ cfg__root_dir=/usr/local/nagiosxi
Aug 15 15:28:02 ++ cfg__script_dir=/usr/local/nagiosxi/scripts
Aug 15 15:28:02 ++ cfg__xidpe_dir=/usr/local/nagios/var/spool/xidpe/
Aug 15 15:28:02 ++ cfg__perfdata_spool=/usr/local/nagios/var/spool/perfdata/
Aug 15 15:28:02 ++ cfg__nom_checkpoints_dir=/usr/local/nagiosxi/nom/checkpoints/                                                                                                                                                              nagioscore/
Aug 15 15:28:02 ++ cfg__use_https=0
Aug 15 15:28:02 ++ cfg__port_number=0
Aug 15 15:28:02 ++ cfg__dbtype=
Aug 15 15:28:02 ++ cfg__dbserver=localhost
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbtype=pgsql
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbserver=
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__user=nagiosxi
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__pwd=n@gweb
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__db=nagiosxi
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__max_auditlog_age=30
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__max_commands_age=480
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__max_events_age=480
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__optimize_interval=60
Aug 15 15:28:02 ++ cfg__db_info__nagiosxi__dbmaint__repair_interval=0
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbtype=mysql
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbserver=172.22.3.125
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__user=nagios
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__pwd=nagios
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__db=nagios
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_externalcommands_age=7
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_logentries_age=90
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_statehistory_age=730
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_notifications_age=90
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_timedevents_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_systemcommands_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_servicechecks_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_hostchecks_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__max_eventhandlers_age=5
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__optimize_interval=60
Aug 15 15:28:02 ++ cfg__db_info__ndoutils__dbmaint__repair_interval=0
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbtype=mysql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbserver=172.22.3.125
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__user=nagiosql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__pwd=nagiosql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__db=nagiosql
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbmaint__max_logbook_age=480
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbmaint__optimize_interval=60
Aug 15 15:28:02 ++ cfg__db_info__nagiosql__dbmaint__repair_interval=0
Aug 15 15:28:02 ++ cfg__db_prefix__ndoutils=nagios_
Aug 15 15:28:02 ++ cfg__db_prefix__nagiosxi=xi_
Aug 15 15:28:02 ++ cfg__db_prefix__nagiosql=tbl_
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__cgi_dir=/usr/local/nagios/sb                                                                                                                                                              in
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__import_dir=/usr/local/nagios                                                                                                                                                              /etc/import
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__plugin_dir=/usr/local/nagios                                                                                                                                                              /libexec
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__cgi_config_file=/usr/local/n                                                                                                                                                              agios/etc/cgi.cfg
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__cmd_file=/usr/local/nagios/v                                                                                                                                                              ar/rw/nagios.cmd
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__log_file=/usr/local/nagios/v                                                                                                                                                              ar/nagios.log
Aug 15 15:28:02 ++ cfg__component_info__nagioscore__nom_checkpoint_interval=1440
Aug 15 15:28:02 ++ cfg__component_info__pnp__perfdata_dir=/usr/local/nagios/shar                                                                                                                                                              e/perfdata
Aug 15 15:28:02 ++ cfg__component_info__pnp__share_dir=/usr/local/nagios/share/p                                                                                                                                                              np
Aug 15 15:28:02 ++ cfg__component_info__pnp__direct_url=/nagios/pnp
Aug 15 15:28:02 ++ cfg__component_info__pnp__username=nagiosxi
Aug 15 15:28:02 ++ cfg__component_info__pnp__password=nagiosadmin
Aug 15 15:28:02 ++ cfg__component_info__perfdata__rrdtool_path=/usr/bin/rrdtool
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__dir=/var/www/html/nagiosql
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__direct_url=/nagiosql
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__username=nagiosxi
Aug 15 15:28:02 ++ cfg__component_info__nagiosql__password=n@gweb
Aug 15 15:28:02 ++ cfg__component_info__nagvis__share_dir=/usr/local/nagios/shar                                                                                                                                                              e/nagvis
Aug 15 15:28:02 ++ cfg__component_info__nagvis__direct_url=/nagios/nagvis
Aug 15 15:28:02 ++ cfg__component_info__nagvis__username=nagiosadmin
Aug 15 15:28:02 ++ cfg__component_info__nagvis__password=nagiosadmin
Aug 15 15:28:02 ++ cfg__demo_mode=0
Aug 15 15:28:02 ++ cfg__dashlet_refresh_multiplier=1000
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__available_updates=86400
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__systat_eventqueuechart=5
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_monitoringstats=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__systat_monitoringperf=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_monitoringproc=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__perfdata_chart=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__network_outages=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__host_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__service_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__hostgroup_status_overview=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__hostgroup_status_grid=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__servicegroup_status_overview=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__servicegroup_status_grid=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__hostgroup_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__servicegroup_status_summary=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_componentstates=7
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__sysstat_serverstats=5
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__network_outages_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__network_health=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__host_status_tac_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__service_status_tac_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__feature_status_tac_summary=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__admin_tasks=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__getting_started=60
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__pagetop_alert_content=30
Aug 15 15:28:02 ++ cfg__dashlet_refresh_rates__tray_alert=30
Aug 15 15:28:02 ++ cfg__memcached_enable=0
Aug 15 15:28:02 ++ cfg__memcached_hosts__0=127.0.0.1
Aug 15 15:28:02 ++ cfg__memcached_hosts__1=192.168.1.3
Aug 15 15:28:02 ++ cfg__memcached_port=11211
Aug 15 15:28:02 ++ cfg__memcached_compress=0
Aug 15 15:28:02 ++ cfg__memcached_ttl=10
Aug 15 15:28:02 ++ cfg__use_basic_authentication=0
Aug 15 15:28:02 ++ cfg__subsystem_basic_auth_username=nagiosxi
Aug 15 15:28:02 ++ cfg__subsystem_basic_auth_password=somepassword
Aug 15 15:28:02 ++ cfg__default_language=en_US
Aug 15 15:28:02 ++ cfg__default_theme=
Aug 15 15:28:02 ++ cfg__languages__en_US=English
Aug 15 15:28:02 ++ cfg__default_instance_id=1
Aug 15 15:28:02 ++ cfg__default_result_records=100000
Aug 15 15:28:02 ++ cfg__online_help_url=http://support.nagios.com/
Aug 15 15:28:02 ++ cfg__feedback_url=http://api.nagios.com/feedback/
Aug 15 15:28:02 ++ cfg__privacy_policy_url=http://www.nagios.com/legal/privacypo                                                                                                                                                              licy/
Aug 15 15:28:02 ++ cfg__db_version=113
Aug 15 15:28:02 ++ cfg__subsystem_ticket=12345
Aug 15 15:28:02 ++ cfg__htaccess_file=/usr/local/nagiosxi/etc/htpasswd.users
Aug 15 15:28:02 ++ cfg__htpasswd_path=/usr/bin/htpasswd
Aug 15 15:28:02 ++ cfg__enable_analytics=1
Aug 15 15:28:02 + echo 'RESETTING PERMS'
Aug 15 15:28:02 RESETTING PERMS
Aug 15 15:28:02 + /bin/chown nagios.nagios /usr/local/nagiosxi/scripts/nagiosql.                                                                                                                                                              cookies /usr/local/nagiosxi/scripts/nagiosql_defaults.sql /usr/local/nagiosxi/sc                                                                                                                                                              ripts/nagiosql.delete.contact /usr/local/nagiosxi/scripts/nagiosql_delete_contac                                                                                                                                                              t.php /usr/local/nagiosxi/scripts/nagiosql_delete_host.php /usr/local/nagiosxi/s                                                                                                                                                              cripts/nagiosql_delete_object.sh /usr/local/nagiosxi/scripts/nagiosql_delete_ser                                                                                                                                                              vice.php /usr/local/nagiosxi/scripts/nagiosql.delete.timeperiod /usr/local/nagio                                                                                                                                                              sxi/scripts/nagiosql_delete_timeperiod.php /usr/local/nagiosxi/scripts/nagiosql_                                                                                                                                                              exportall.php /usr/local/nagiosxi/scripts/nagiosql.export.monitoring /usr/local/                                                                                                                                                              nagiosxi/scripts/nagiosql_importall.php /usr/local/nagiosxi/scripts/nagiosql.imp                                                                                                                                                              ort.monitoring /usr/local/nagiosxi/scripts/nagiosql.login /usr/local/nagiosxi/sc                                                                                                                                                              ripts/nagiosql_login.php /usr/local/nagiosxi/scripts/nagiosql_snapshot.sh /usr/l                                                                                                                                                              ocal/nagiosxi/scripts/nagiosql_trim_backups.sh
Aug 15 15:28:02 + /bin/chmod 775 /usr/local/nagiosxi/scripts/nagiosql.cookies /u                                                                                                                                                              sr/local/nagiosxi/scripts/nagiosql_defaults.sql /usr/local/nagiosxi/scripts/nagi                                                                                                                                                              osql.delete.contact /usr/local/nagiosxi/scripts/nagiosql_delete_contact.php /usr                                                                                                                                                              /local/nagiosxi/scripts/nagiosql_delete_host.php /usr/local/nagiosxi/scripts/nag                                                                                                                                                              iosql_delete_object.sh /usr/local/nagiosxi/scripts/nagiosql_delete_service.php /                                                                                                                                                              usr/local/nagiosxi/scripts/nagiosql.delete.timeperiod /usr/local/nagiosxi/script                                                                                                                                                              s/nagiosql_delete_timeperiod.php /usr/local/nagiosxi/scripts/nagiosql_exportall.                                                                                                                                                              php /usr/local/nagiosxi/scripts/nagiosql.export.monitoring /usr/local/nagiosxi/s                                                                                                                                                              cripts/nagiosql_importall.php /usr/local/nagiosxi/scripts/nagiosql.import.monito                                                                                                                                                              ring /usr/local/nagiosxi/scripts/nagiosql.login /usr/local/nagiosxi/scripts/nagi                                                                                                                                                              osql_login.php /usr/local/nagiosxi/scripts/nagiosql_snapshot.sh /usr/local/nagio                                                                                                                                                              sxi/scripts/nagiosql_trim_backups.sh
Aug 15 15:28:02 + /bin/chown -R apache:nagios /usr/local/nagios/etc/
Aug 15 15:28:02 + /bin/chmod -R ug+rw /usr/local/nagios/etc/
Aug 15 15:28:02 + /bin/chmod -R 775 /usr/local/nagios/share/perfdata/
Aug 15 15:31:11 /bin/chmod: cannot access `/usr/local/nagios/share/perfdata/WEL_F2_2960-S22/If_FastEthernet0_12.xml.9930': No such file or directory
Aug 15 15:31:20 + /bin/chown -R nagios.nagios /usr/local/nagios/share/perfdata
Aug 15 15:31:20 + /bin/chmod 775 /usr/local/nagios/libexec
Aug 15 15:31:20 + /bin/chown nagios:nagios /usr/local/nagiosxi/nom/checkpoints/nagiosxi
Aug 15 15:31:20 + '[' -f /usr/local/nagiosxi/var/corelog.newobjects ']'
Aug 15 15:31:20 + '[' -f /usr/local/nagiosxi/etc/components/ccm_config.inc.php ']'
Aug 15 15:31:20 + /bin/chown apache.nagios /usr/local/nagiosxi/etc/components/ccm_config.inc.php

[ssax]

What is the output of this command?

Code: Select all

time /bin/chmod -R 775 /usr/local/nagios/share/perfdata/

Looks like it's taking all the time looping through your perfdata, how many files do you have in there?

Code: Select all

find /usr/local/nagios/share/perfdata/ * | wc -l

[benhank]

Code: Select all

# find /usr/local/nagios/share/perfdata/ * | wc -l
75736

and

Code: Select all

# time /bin/chmod -R 775 /usr/local/nagios/share/perfdata/
/bin/chmod: cannot access `/usr/local/nagios/share/perfdata/LIB-3750-1/If_GigabitEthernet2_0_17.xml.6183': No such file or directory

real    2m0.949s
user    0m0.157s
sys     0m2.038s

[ssax]

75736, that's a lot of files to parse through, are there any old ones you can clean up?

[benhank]

I think the perfdata is the problem. I deleted all of the perfdata on my secondary, and the apply config went a lot faster.
But now im in trouble, deleting perfdata is not a solution I can go to my team with...

[bwallace]

Deleting pefdata to increase performance is certainly not the norm. Something caused these 75736 files to accumulate in the 1st place but it's going to be difficult to determine the cause now, however the 1st culprit to consider is if the npcd daemon stopped running at some point. When that happens, you would first see files accumulating in /usr/local/Nagios/var/spool/perfdata.
By any chance did you take note of the old filenames you deleted and was any attempt made at linking those to currently inactive hosts or service checks?

In terms of increasing performance, I would implement the suggestions from tmcdonald from a few posts back. Should probably keep an eye on the following in the meantime:
/usr/local/nagios/var/perfdata.log
/usr/local/nagios/var/npcd.log

[benhank]

I have a question.
Nagios core runs fast very fast, even with the perfdata issue we discovered. But Nagiosxi, doesn't. pages take longer to load, and the overall feel is sorta sluggish on all my servers.
So my question is : what is the difference between how XI functions over core?
If I do a restart of the nagios service via the command line its fast, do the same thing with xi and slowness happens.
Whats the difference between an apply config done at the command line and an apply config done via the ccm gui?

[tmcdonald]

Lots of differences:

* Core is written in C, XI in PHP (interpreted, so a lot slower than a binary)
* XI has a lot more functionality, more detailed pages, a database and logfiles to dig through
* XI relies on Core on the backend, so almost by definition can never run as fast/faster
* Apply Config is doing a lot more than just a restart of the service, such as checking the database for changes, writing configs, and verifying them before ever restarting the Core process

Not a ton can be done about a lot of these. We won't be writing XI in C any time soon, or removing functionality. It needs to rely on Core, and databases are not written by us so we can't do much to speed them up directly (we can speed up our queries though). Apply Config needs to do these things to ensure that the process restarts cleanly.

[benhank]

ah I see. I hope my question didn't give you guys the impression I was talking trash.
I asked the question because I want to figure out how to troubleshoot nagios's backend with service checks or even the NLS. Im actually glad than I am having this problem because its forcing me to look even deeper into centos's diagnostic tools and resources with an urgency I never had before. (glances is teh BOMB! and that TS hookup is the >cencored<!! thanks for that man!)
So please fellas dont misunderstand, I say now what I have always stated, I may be frustrated because of the problem, but I got no issues with the Jedi Council, whose gungfu is teh BEST

Ok so back to the issue. Whats should i do next. Should I do the ramdrive, or mod gearmon? and if I do the ram drive, how much should I allocate to it?

[tgriep]

We do have a guide you can look at for performance enhancements you can do on your server.
https://assets.nagios.com/downloads/nag ... ios-XI.pdf

The size of the ramdisk depends on how many checks the system is running but 500 meg is a good starting point on a larger system.