Page 1 of 2

Service Detail Screens and Config/Services screen not loadin

Posted: Fri Jul 29, 2016 1:48 pm
by sujitt
Hi,

We were able to view service details and config/services screen with no issues until yesterday PM. Now they do not load.

Here are the details of the environment and counts
Nagios XI Installation Profile

Our total services count is at : 2931 out of this 80% are passive.
hosts : 185


Download Profile
System:

Nagios XI Version : 2014R1.5
gaatlp81u 2.6.32-358.2.1.el6.x86_64 x86_64
CentOS release 6.4 (Final)
Gnome is not installed
Apache Information

PHP Version: 5.3.3
Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36
Server Name: gaatlp81u.corp.aglrsc.com
Server Address: 10.2.2.100
Server Port: 80
Date/Time

PHP Timezone: America/New_York
PHP Time: Fri, 29 Jul 2016 14:43:31 -0400
System Time: Fri, 29 Jul 2016 14:43:31 -0400
Nagios XI Data

License ends in: NTOSNM

nagios (pid 27080) is running...
NPCD running (pid 26909).
ndo2db (pid 26900) is running...
CPU Load 15: 0.77
Total Hosts: 185
Total Services: 2931
Function 'get_base_uri' returns: http://gaatlp81u.corp.aglrsc.com/nagiosxi/
Function 'get_base_url' returns: http://gaatlp81u.corp.aglrsc.com/nagiosxi/
Function 'get_backend_url(internal_call=false)' returns: http://gaatlp81u.corp.aglrsc.com/nagios ... rofile.php
Function 'get_backend_url(internal_call=true)' returns: http://localhost/nagiosxi/backend/
Ping Test localhost

Running:
/bin/ping -c 3 localhost 2>&1
PING localhost (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.036 ms
64 bytes from localhost (127.0.0.1): icmp_seq=2 ttl=64 time=0.036 ms
64 bytes from localhost (127.0.0.1): icmp_seq=3 ttl=64 time=0.049 ms

--- localhost ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 0.036/0.040/0.049/0.008 ms
Test wget To localhost

WGET From URL: http://localhost/nagiosxi/includes/components/ccm/
Running:
/usr/bin/wget http://localhost/nagiosxi/includes/components/ccm/
--2016-07-29 14:43:33-- http://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... ::1, 127.0.0.1
Connecting to localhost|::1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: "/usr/local/nagiosxi/tmp/ccm_index.tmp"

0K ......... 649K=0.01s

2016-07-29 14:43:33 (649 KB/s) - "/usr/local/nagiosxi/tmp/ccm_index.tmp" saved [9666]

Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 1:55 pm
by tgriep
Can you login to the XI server as root, run the following command

Code: Select all

tail -f /var/log/httpd/*_log
Next, try and open those screens and post the output of the tail command.

Also, run the following and post the output here so we can view some information

Code: Select all

ps -ef --cols=300
tail /var/log/mysqld.log

Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 1:59 pm
by lmiltchev
Does it help if you stop/start services?

Code: Select all

service nagios stop
service ndo2db stop
service ndo2db start
service nagios start
service mysqld restart
service postgresql restart
If this is not helping, run the following commands and show the output in code wraps:

Code: Select all

df -h
df -i
tail -20 /var/log/mysqld.log
tail -50 /var/log/httpd/error_log
tail -50 /var/log/messages

Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 2:02 pm
by sujitt
Service details works ok for normal user.

Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 2:06 pm
by sujitt
I did restart all the services as suggested in previous listing. Here is the dump of the tails


Code: Select all

[Thu Jul 28 17:49:50 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 17:49:54 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/?cmd=view&type=service
[Thu Jul 28 17:49:54 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/?cmd=view&type=service
[Thu Jul 28 17:58:48 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php
[Thu Jul 28 18:01:29 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:01:29 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:01:35 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:13:40 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:13:40 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:13:46 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/?cmd=view&type=service
[Thu Jul 28 18:13:46 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/?cmd=view&type=service
[Thu Jul 28 18:13:55 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/index.php
[Thu Jul 28 18:14:12 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:14:12 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Thu Jul 28 18:25:19 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php
[Thu Jul 28 18:25:49 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php?mode=edit&edit=AVAYA_GROUP&dir=configs
[Thu Jul 28 18:50:16 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php?mode=edit&edit=AVAYA_GROUP&dir=configs
[Thu Jul 28 18:50:52 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php?mode=edit&edit=AVAYA_GROUP&dir=configs
[Thu Jul 28 18:50:58 2016] [error] [client 10.132.0.255] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php?mode=edit&edit=AVAYA_GROUP&dir=configs
[Fri Jul 29 11:47:47 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:47:55 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:04 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:13 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:26 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:44 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:51 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:53 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:48:57 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 11:51:21 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 13:38:38 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 13:41:30 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 13:41:32 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 13:41:32 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 13:41:37 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 14:01:35 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined index: HOSTNAME in /usr/local/nagiosxi/html/includes/components/nrdsconfigmanager/nrdsconfigmanager.php on line 559, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/nrdsconfigmanager/nrdsconfigmanager.php
[Fri Jul 29 14:03:03 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 14:03:03 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 14:54:31 2016] [error] [client 10.100.61.238] PHP Warning:  array_multisort(): Argument #1 is expected to be an array or a sort flag in /usr/local/nagiosxi/html/includes/utils-dashboards.inc.php on line 276, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/admin/users.php?useradded
[Fri Jul 29 14:56:27 2016] [error] [client 10.100.61.238] PHP Warning:  array_multisort(): Argument #1 is expected to be an array or a sort flag in /usr/local/nagiosxi/html/includes/utils-dashboards.inc.php on line 276, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/login.php?logout
[Fri Jul 29 14:56:27 2016] [error] [client 10.100.61.238] PHP Warning:  array_multisort(): Argument #1 is expected to be an array or a sort flag in /usr/local/nagiosxi/html/includes/utils-dashboards.inc.php on line 276, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/login.php?logout
[Fri Jul 29 14:59:32 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: ac_needed_js_inject in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 175, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 14:59:32 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: sync_table_status in /usr/local/nagiosxi/html/includes/components/ccm/page_templates/ccm_table.php on line 195, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Warning:  pg_pconnect(): PostgreSQL link lost, unable to reconnect in /usr/local/nagiosxi/html/db/adodb/drivers/adodb-postgres64.inc.php on line 682, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: result in /usr/local/nagiosxi/html/includes/db.inc.php on line 241, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Warning:  pg_pconnect(): PostgreSQL link lost, unable to reconnect in /usr/local/nagiosxi/html/db/adodb/drivers/adodb-postgres64.inc.php on line 682, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: result in /usr/local/nagiosxi/html/includes/db.inc.php on line 241, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Warning:  pg_pconnect(): Unable to connect to PostgreSQL server: could not connect to server: Connection refused\n\tIs the server running on host "localhost" and accepting\n\tTCP/IP connections on port 5432?\ncould not connect to server: Connection refused\n\tIs the server running on host "localhost" and accepting\n\tTCP/IP connections on port 5432? in /usr/local/nagiosxi/html/db/adodb/drivers/adodb-postgres64.inc.php on line 682, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: result in /usr/local/nagiosxi/html/includes/db.inc.php on line 241, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Warning:  pg_pconnect(): Unable to connect to PostgreSQL server: could not connect to server: Connection refused\n\tIs the server running on host "localhost" and accepting\n\tTCP/IP connections on port 5432?\ncould not connect to server: Connection refused\n\tIs the server running on host "localhost" and accepting\n\tTCP/IP connections on port 5432? in /usr/local/nagiosxi/html/db/adodb/drivers/adodb-postgres64.inc.php on line 682, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php
[Fri Jul 29 15:04:38 2016] [error] [client 10.100.61.238] PHP Notice:  Undefined variable: result in /usr/local/nagiosxi/html/includes/db.inc.php on line 241, referer: http://gaatlp81u.corp.aglrsc.com/nagiosxi/includes/components/ccm/xi-index.php

Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 2:08 pm
by sujitt
messages file listing

Code: Select all

Jul 29 15:04:22 localhost rsyslogd-2177: imuxsock lost 30429 messages from pid 15421 due to rate-limiting
Jul 29 15:04:42 localhost xinetd[18018]: START: nrpe pid=15922 from=::ffff:10.2.2.103
Jul 29 15:04:42 localhost xinetd[18018]: EXIT: nrpe status=0 pid=15922 duration=0(sec)
Jul 29 15:04:47 localhost xinetd[18018]: START: nrpe pid=15962 from=::ffff:10.2.2.103
Jul 29 15:04:47 localhost xinetd[18018]: EXIT: nrpe status=0 pid=15962 duration=0(sec)
Jul 29 15:04:48 localhost xinetd[18018]: START: nrpe pid=16002 from=::ffff:10.2.2.103
Jul 29 15:04:48 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16002 duration=0(sec)
Jul 29 15:04:57 localhost xinetd[18018]: START: nrpe pid=16087 from=::ffff:10.2.2.103
Jul 29 15:04:57 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16087 duration=0(sec)
Jul 29 15:04:58 localhost xinetd[18018]: START: nrpe pid=16092 from=::ffff:10.2.2.103
Jul 29 15:04:58 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16092 duration=0(sec)
Jul 29 15:05:12 localhost xinetd[18018]: START: nrpe pid=16341 from=::ffff:10.2.2.103
Jul 29 15:05:12 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16341 duration=0(sec)
Jul 29 15:05:16 localhost rsyslogd-2177: imuxsock lost 180 messages from pid 15410 due to rate-limiting
Jul 29 15:05:16 localhost nagios: Warning: The results of service 'WMS : WMS SSIS Package failures Audit' on host 'agasc35u' are stale by 0d 0h 1m 24s (threshold=0d 0h 0m 20s).  I'm forcing an immediate check of the service.
Jul 29 15:05:16 localhost nagios: Warning: The results of service 'Click Outgoing Messages Count' on host 'agasc41u' are stale by 0d 0h 1m 24s (threshold=0d 0h 0m 20s).  I'm forcing an immediate check of the service.
Jul 29 15:05:18 localhost xinetd[18018]: START: nrpe pid=16394 from=::ffff:10.2.2.103
Jul 29 15:05:19 localhost xinetd[18018]: START: nrpe pid=16422 from=::ffff:10.2.2.103
Jul 29 15:05:19 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16422 duration=0(sec)
Jul 29 15:05:20 localhost xinetd[18018]: START: nrpe pid=16446 from=::ffff:10.2.2.103
Jul 29 15:05:20 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16446 duration=0(sec)
Jul 29 15:05:20 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16394 duration=2(sec)
Jul 29 15:05:29 localhost xinetd[18018]: START: nrpe pid=16595 from=::ffff:10.2.2.103
Jul 29 15:05:29 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16595 duration=0(sec)
Jul 29 15:05:40 localhost xinetd[18018]: START: nrpe pid=16674 from=::ffff:10.2.2.103
Jul 29 15:05:45 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16674 duration=5(sec)
Jul 29 15:05:49 localhost xinetd[18018]: START: nsca pid=16809 from=::ffff:10.1.17.142
Jul 29 15:05:50 localhost xinetd[18018]: EXIT: nsca status=0 pid=16809 duration=1(sec)
Jul 29 15:05:50 localhost nagios: SERVICE ALERT: poseidon24;CM-CCCB001;CRITICAL;HARD;1;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: Comproom;poseidon24;CM-CCCB001;CRITICAL;notify-service-by-email;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: sapierce;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: abhojwa;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: apearman;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: bhicks;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: bshahro;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: dca_nagios;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: dcruz;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: nagiosadmin;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: umascor;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:50 localhost nagios: SERVICE NOTIFICATION: vamstut;poseidon24;CM-CCCB001;CRITICAL;xi_service_notification_handler;/spl_wspace/PRDCCB/restart_files/master_2q4pk_CM-CCCB001.restart.sh
Jul 29 15:05:52 localhost xinetd[18018]: START: nrpe pid=16885 from=::ffff:10.2.2.103
Jul 29 15:05:52 localhost xinetd[18018]: EXIT: nrpe status=0 pid=16885 duration=0(sec)
Jul 29 15:06:15 localhost xinetd[18018]: START: nrpe pid=17181 from=::ffff:10.2.2.103
Jul 29 15:06:16 localhost xinetd[18018]: EXIT: nrpe status=0 pid=17181 duration=1(sec)
Jul 29 15:06:16 localhost nagios: Warning: The results of service 'WMS : WMS SSIS Package failures Audit' on host 'agasc35u' are stale by 0d 0h 0m 40s (threshold=0d 0h 0m 20s).  I'm forcing an immediate check of the service.
Jul 29 15:06:16 localhost nagios: Warning: The results of service 'Click Outgoing Messages Count' on host 'agasc41u' are stale by 0d 0h 0m 40s (threshold=0d 0h 0m 20s).  I'm forcing an immediate check of the service.
Jul 29 15:06:49 localhost xinetd[18018]: START: nrpe pid=17526 from=::ffff:10.2.2.103
Jul 29 15:06:49 localhost xinetd[18018]: EXIT: nrpe status=0 pid=17526 duration=0(sec)
Jul 29 15:07:03 localhost xinetd[18018]: START: nrpe pid=17748 from=::ffff:10.2.2.103
Jul 29 15:07:03 localhost xinetd[18018]: EXIT: nrpe status=0 pid=17748 duration=0(sec)


Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 2:27 pm
by sujitt
servicesscreen.png
Looks like I do not have anything in my services . Because when I search for services in config. It just takes me back to the coreadmin screen. Here is the screen shots before hitting search and after search

Re: Service Detail Screens and Config/Services screen not lo

Posted: Fri Jul 29, 2016 3:11 pm
by sujitt
is there a way to check the db to ensure all services are in the table ?

Re: Service Detail Screens and Config/Services screen not lo

Posted: Sun Jul 31, 2016 9:19 pm
by Box293
Can you please follow this article to run the database repair process as I believe you may have some database issues:

https://support.nagios.com/kb/article.php?id=24

This may take a while to complete. Once it has, please scroll back up through the history to make sure there were not any database errors (you may see an ndo2db error when stopping the service but this is ok).

Re: Service Detail Screens and Config/Services screen not lo

Posted: Wed Aug 03, 2016 11:39 am
by sujitt
Things seem to be working today. No Idea what happened. But screenloading has become slower . mostly due to the number of services on it.