Nagios Support Forum

Support for Nagios products and services
https://support.nagios.com/forum/

Passive checks - freshness check ?

https://support.nagios.com/forum/viewtopic.php?t=36146

Page 1 of 1

Passive checks - freshness check ?

Posted: Thu Dec 10, 2015 8:49 am
by bipsen
Hi

From a remote server, I have scheduled a check which submits a result every 5 minutes.... On my Nagios server, the check is inserted by the nsca daemon.. Only issue is, that it sometimes shows up as stale - and I cannot figure out why...

From my nagios.log:

Code: Select all

[1449754386] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754395] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754395] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;OK;SOFT;2;Everything seems ok.
[1449754395] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;CRITICAL;SOFT;1;CRITICAL: Service check is stale!
[1449754567] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754575] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754575] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;OK;SOFT;2;Everything seems ok.
[1449754746] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754752] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754752] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;CRITICAL;SOFT;1;CRITICAL: Service check is stale!
[1449754926] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754932] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754932] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;OK;SOFT;2;Everything seems ok.
[1449755106] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449755112] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449755112] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;CRITICAL;SOFT;1;CRITICAL: Service check is stale!
My configuration of this service:

Code: Select all

define service {
        hostgroup_name                  TCRS-TSM-FILEDBVM-DD,TCRS-TSM-VM-DD
        service_description             TSM DB-META DISK Pool Utilization
        display_name                    DB-Meta Disk Pool Util
        use                             passive-service,graphed-service
        check_command                   check_dummy!2!"Service check is stale\!"
        max_check_attempts              3
        check_interval                  6
        retry_interval                  6
        active_checks_enabled           0
        passive_checks_enabled          1
        check_period                    24x7
        check_freshness                 1
        freshness_threshold             720
        flap_detection_enabled          0
        notification_interval           720
        notification_period             none
        notification_options            w,c,r
        notifications_enabled           1
        icon_image                      graph.png
        register                        1
}
Why is the freshness command triggered - when all submitted check run on a regular interval, and never is more than 720 seconds old?

/Brian

Re: Passive checks - freshness check ?

Posted: Thu Dec 10, 2015 6:09 pm
by tmcdonald
What Core version are you running?

Re: Passive checks - freshness check ?

Posted: Thu Dec 10, 2015 6:14 pm
by Box293
Can you please run this command and send us the output:

Code: Select all

ps -ef | grep nagios.cfg

Re: Passive checks - freshness check ?

Posted: Fri Dec 11, 2015 3:59 am
by bipsen
tmcdonald wrote:What Core version are you running?
Nagios Core is 3.5.1

Re: Passive checks - freshness check ?

Posted: Fri Dec 11, 2015 4:01 am
by bipsen
Box293 wrote:Can you please run this command and send us the output:

Code: Select all

ps -ef | grep nagios.cfg

Code: Select all

# ps -ef | grep nagios.cfg
nagios     308 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios     347 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3400 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3417 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3498 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3518 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3536 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3563 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3580 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4129 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4138 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4150 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4164 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4185 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4208 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4224 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4265 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4326 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4351 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4385 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4420 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4464 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4502 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4573 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5354 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5381 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5404 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5434 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5456 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5493 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5524 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6027 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6056 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6079 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6107 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6154 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6187 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6225 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6255 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6345 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6411 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6476 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6514 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6542 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6787 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6817 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6857 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6909 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6985 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    7040 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    7087 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
root      7117  5570  0 10:00 pts/0    00:00:00 grep --color=tty nagios.cfg
nagios    7140 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios   19228     1  5 Nov17 ?        1-06:35:17 /usr/sbin/nagios -d /etc/nagios/nagios.cfg

Re: Passive checks - freshness check ?

Posted: Fri Dec 11, 2015 3:27 pm
by rkennedy
Can you post the config for passive-service, and graphed-service?

Re: Passive checks - freshness check ?

Posted: Sat Dec 12, 2015 1:31 pm
by bipsen

Code: Select all

define service {
        name                            graphed-service
        action_url                      /nagios/cgi-bin/show.cgi?host=$HOSTNAME$&service=$SERVICEDESC$' onMouseOver='showGraphPopup(this)' onMouseOut='hideGraphPopup()' rel='/nagios/cgi-bin/showgraph.cgi?host=$HOSTNAME$&service=$SERVICEDESC$
        register                        0
}

define service {
        name                            passive-service
        is_volatile                     0
        max_check_attempts              1
        check_interval                  129600
        retry_interval                  129600
        active_checks_enabled           1
        passive_checks_enabled          1
        check_period                    none
        obsess_over_service             0
        check_freshness                 0
        event_handler_enabled           1
        flap_detection_enabled          1
        retain_nonstatus_information    1
        notification_interval           60
        notification_period             24x7
        notification_options            w,u,c,r
        register                        0
}

Re: Passive checks - freshness check ?

Posted: Mon Dec 14, 2015 12:44 am
by Box293
This shouldn't matter, but lets change it anyway.
In your passive-service template, set active_checks_enabled 0

Does that make any difference?

Re: Passive checks - freshness check ?

Posted: Tue Dec 15, 2015 10:08 am
by bipsen
Thanks - that did the trick... I have spent hours trying to figure out what the problem was, and sometimes when you troubleshoot a problem for a longer time, some details are missed :-)

/Brian

Re: Passive checks - freshness check ?

Posted: Tue Dec 15, 2015 10:45 am
by bwallace
Glad we were able to help. We'll lock this thread now and feel free to open another should you require assistance with anything else.
All times are UTC-05:00
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited