check_http is stuck in pending.

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
s.dehaan
Posts: 16
Joined: Thu Apr 12, 2012 7:18 am

check_http is stuck in pending.

Post by s.dehaan »

Hi Everyone,

I am experiancing the following issue. Everytime I try to configure a service with the check_http command. The services stays in Pending state forever. It does not shedule the next check. Nor does it register the initial check.

When I check the advanced status details, this is what I get:
  • Service State: Pending
    Duration: N/A
    State Type: Hard
    Current Check: 1 of 3
    Last Check: Never
    Next Check: Not scheduled
    Last State Change: Never
    Last Notification: Never
    Check Type: Active
    Check Latency: 5.844 seconds
    Execution Time: 2.3372 seconds
    State Change: 0%
service config:

Code: Select all

define service {
        host_name                       example.com
        service_description             example.com check_http_resp
        use                             CHECK-5MIN,NOTIFY-EMAIL-ADMINS
        display_name                    check_http_res
        servicegroups                   example
        check_command                   check_http!-u <url> -f follow -v -r "pattern"!!!!!!!
        register                        1
        }
CHECK-5MIN template:

Code: Select all

define service {
       name                                     CHECK-5MIN
       max_check_attempts                       3
       check_interval                           5
       retry_interval                           1
       active_checks_enabled                    1
       check_period                             24x7
       register                                 0
}
NOTIFY-EMAIL-ADMINS template:

Code: Select all

define service {
       name                                     NOTIFY-EMAIL-ADMINS
       notification_interval                    0
       notification_period                      24x7
       notification_options                     r,c
       notifications_enabled                    1
       contact_groups                           Admins
       register                                 0
}
I hope you guys can shine some light on this. Because I've been trying to solve this issue for a few days now.

Thanks.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: check_http is stuck in pending.

Post by scottwilkerson »

If you click on "Schedule an immediate check" on the details overview page does it kick it off?
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
s.dehaan
Posts: 16
Joined: Thu Apr 12, 2012 7:18 am

Re: check_http is stuck in pending.

Post by s.dehaan »

scottwilkerson wrote:If you click on "Schedule an immediate check" on the details overview page does it kick it off?
No it does not.

-- edit --

following up on that. When I click it once, it does seem to retrieve the results. Only the status stays pending. The option for a force-check is no longer available and the status details result is this:
  • Service State: Pending
    Duration: N/A
    Service Stability: Changing
    Current Check: 0 of 0
    Last Check: Never
    Next Check: Not scheduled
    Service Notes:Service notifications are disabled
-- edit 2 --
When I click the button view this service in Nagios Core... It shows me the entire service as status: OK ...
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: check_http is stuck in pending.

Post by scottwilkerson »

First, what version of XI are your running?

I am thinking of 2 possible causes, lets try these.

From the console run the following

Code: Select all

service nagios stop
service ndo2db stop
killall -9 ndo2db
killall -9 nagios
service ndo2db start
service nagios start
If you have the same results, lets make sure we don't have any corrupt database tables, run

Code: Select all

service mysqld stop
/usr/local/nagiosxi/scripts/repairmysql.sh nagios *
service mysqld start
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
s.dehaan
Posts: 16
Joined: Thu Apr 12, 2012 7:18 am

Re: check_http is stuck in pending.

Post by s.dehaan »

I have performed both actions. However the result remains the same.
Some of the values however have changes (below). The force check now button dissapeared after one click.
  • Service State: Pending
    Duration: 15512d 9h 42m 9s
    Service Stability: Unchanging (stable)
    Last Check: 01/01/1970 00:00:00
    Next Check: 01/01/1970 00:00:00
I am running Vmware image with Nagios XI 2011R3.1 licensed.

Thanks for your continued help!
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: check_http is stuck in pending.

Post by scottwilkerson »

Can you send the output from Admin -> System Profile
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
s.dehaan
Posts: 16
Joined: Thu Apr 12, 2012 7:18 am

Re: check_http is stuck in pending.

Post by s.dehaan »

scottwilkerson wrote:Can you send the output from Admin -> System Profile
I send it to you in a pm message.

Thanks.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: check_http is stuck in pending.

Post by scottwilkerson »

This all looks normal.

I'm beginning to wonder if this is related to this bug

Code: Select all

http://support.nagios.com/wiki/index.php/Nagios_XI:FAQs#Upgrade_to_2011R3.x_Issues
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
s.dehaan
Posts: 16
Joined: Thu Apr 12, 2012 7:18 am

Re: check_http is stuck in pending.

Post by s.dehaan »

scottwilkerson wrote:This all looks normal.

I'm beginning to wonder if this is related to this bug

Code: Select all

http://support.nagios.com/wiki/index.php/Nagios_XI:FAQs#Upgrade_to_2011R3.x_Issues
I can certainly try the things written in this FAQ. One thing I did notice was that we had a malfunction today with the exact service that we are monitoring. And it send out notifications just like it was supposed to do. In other words, it seems to be working just fine. Only in the Nagios XI interface it shows up as pending.

Thanks!
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: check_http is stuck in pending.

Post by scottwilkerson »

It is possible that this is the cause, the bug referenced in the link I sent will make the database (that the web page reads out of) update at an extremely slow pace...
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Locked