Passive checks - freshness check ?

Support forum for Nagios Core, Nagios Plugins, NCPA, NRPE, NSCA, NDOUtils and more. Engage with the community of users including those using the open source solutions.
Locked
bipsen
Posts: 22
Joined: Thu Dec 10, 2015 8:42 am
Location: Denmark

Passive checks - freshness check ?

Post by bipsen »

Hi

From a remote server, I have scheduled a check which submits a result every 5 minutes.... On my Nagios server, the check is inserted by the nsca daemon.. Only issue is, that it sometimes shows up as stale - and I cannot figure out why...

From my nagios.log:

Code: Select all

[1449754386] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754395] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754395] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;OK;SOFT;2;Everything seems ok.
[1449754395] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;CRITICAL;SOFT;1;CRITICAL: Service check is stale!
[1449754567] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754575] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754575] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;OK;SOFT;2;Everything seems ok.
[1449754746] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754752] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754752] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;CRITICAL;SOFT;1;CRITICAL: Service check is stale!
[1449754926] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449754932] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449754932] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;OK;SOFT;2;Everything seems ok.
[1449755106] EXTERNAL COMMAND: PROCESS_SERVICE_CHECK_RESULT;rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok. | BACKUP-DB-META-DISK=50.2%;88;95;0;100
[1449755112] PASSIVE SERVICE CHECK: rs001b;TSM DB-META DISK Pool Utilization;0;Everything seems ok.
[1449755112] SERVICE ALERT: rs001b;TSM DB-META DISK Pool Utilization;CRITICAL;SOFT;1;CRITICAL: Service check is stale!
My configuration of this service:

Code: Select all

define service {
        hostgroup_name                  TCRS-TSM-FILEDBVM-DD,TCRS-TSM-VM-DD
        service_description             TSM DB-META DISK Pool Utilization
        display_name                    DB-Meta Disk Pool Util
        use                             passive-service,graphed-service
        check_command                   check_dummy!2!"Service check is stale\!"
        max_check_attempts              3
        check_interval                  6
        retry_interval                  6
        active_checks_enabled           0
        passive_checks_enabled          1
        check_period                    24x7
        check_freshness                 1
        freshness_threshold             720
        flap_detection_enabled          0
        notification_interval           720
        notification_period             none
        notification_options            w,c,r
        notifications_enabled           1
        icon_image                      graph.png
        register                        1
}
Why is the freshness command triggered - when all submitted check run on a regular interval, and never is more than 720 seconds old?

/Brian
Top
tmcdonald
Posts: 9117
Joined: Mon Sep 23, 2013 8:40 am

Re: Passive checks - freshness check ?

Post by tmcdonald »

What Core version are you running?
Former Nagios employee
Top
User avatar
Box293
Too Basu
Posts: 5126
Joined: Sun Feb 07, 2010 10:55 pm
Location: Deniliquin, Australia
Contact:
Contact Box293

Re: Passive checks - freshness check ?

Post by Box293 »

Can you please run this command and send us the output:

Code: Select all

ps -ef | grep nagios.cfg
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
Top
bipsen
Posts: 22
Joined: Thu Dec 10, 2015 8:42 am
Location: Denmark

Re: Passive checks - freshness check ?

Post by bipsen »

tmcdonald wrote:What Core version are you running?
Nagios Core is 3.5.1
Top
bipsen
Posts: 22
Joined: Thu Dec 10, 2015 8:42 am
Location: Denmark

Re: Passive checks - freshness check ?

Post by bipsen »

Box293 wrote:Can you please run this command and send us the output:

Code: Select all

ps -ef | grep nagios.cfg

Code: Select all

# ps -ef | grep nagios.cfg
nagios     308 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios     347 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3400 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3417 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3498 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3518 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3536 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3563 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    3580 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4129 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4138 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4150 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4164 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4185 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4208 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4224 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4265 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4326 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4351 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4385 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4420 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4464 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4502 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    4573 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5354 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5381 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5404 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5434 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5456 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5493 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    5524 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6027 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6056 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6079 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6107 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6154 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6187 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6225 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6255 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6345 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6411 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6476 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6514 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6542 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6787 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6817 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6857 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6909 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    6985 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    7040 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios    7087 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
root      7117  5570  0 10:00 pts/0    00:00:00 grep --color=tty nagios.cfg
nagios    7140 19228  0 10:00 ?        00:00:00 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
nagios   19228     1  5 Nov17 ?        1-06:35:17 /usr/sbin/nagios -d /etc/nagios/nagios.cfg
Top
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: Passive checks - freshness check ?

Post by rkennedy »

Can you post the config for passive-service, and graphed-service?
Former Nagios Employee
Top
bipsen
Posts: 22
Joined: Thu Dec 10, 2015 8:42 am
Location: Denmark

Re: Passive checks - freshness check ?

Post by bipsen »

Code: Select all

define service {
        name                            graphed-service
        action_url                      /nagios/cgi-bin/show.cgi?host=$HOSTNAME$&service=$SERVICEDESC$' onMouseOver='showGraphPopup(this)' onMouseOut='hideGraphPopup()' rel='/nagios/cgi-bin/showgraph.cgi?host=$HOSTNAME$&service=$SERVICEDESC$
        register                        0
}

define service {
        name                            passive-service
        is_volatile                     0
        max_check_attempts              1
        check_interval                  129600
        retry_interval                  129600
        active_checks_enabled           1
        passive_checks_enabled          1
        check_period                    none
        obsess_over_service             0
        check_freshness                 0
        event_handler_enabled           1
        flap_detection_enabled          1
        retain_nonstatus_information    1
        notification_interval           60
        notification_period             24x7
        notification_options            w,u,c,r
        register                        0
}
Top
User avatar
Box293
Too Basu
Posts: 5126
Joined: Sun Feb 07, 2010 10:55 pm
Location: Deniliquin, Australia
Contact:
Contact Box293

Re: Passive checks - freshness check ?

Post by Box293 »

This shouldn't matter, but lets change it anyway.
In your passive-service template, set active_checks_enabled 0

Does that make any difference?
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
Top
bipsen
Posts: 22
Joined: Thu Dec 10, 2015 8:42 am
Location: Denmark

Re: Passive checks - freshness check ?

Post by bipsen »

Thanks - that did the trick... I have spent hours trying to figure out what the problem was, and sometimes when you troubleshoot a problem for a longer time, some details are missed :-)

/Brian
Top
bwallace
Posts: 1145
Joined: Tue Nov 17, 2015 1:57 pm

Re: Passive checks - freshness check ?

Post by bwallace »

Glad we were able to help. We'll lock this thread now and feel free to open another should you require assistance with anything else.
Be sure to check out the Knowledgebase for helpful articles and solutions!
Top
Locked

Return to “Open Source Nagios Projects”