gearman - a lot JOBs waiting

[tmcdonald]

The queue may very well build up if a lot of checks are being run, but it should go back down after a bit. Is the problem that the queue never clears, or that it sometimes isn't at 0?

Can you also address the other questions from @bheden's last post? In particular if you increased the results worker in the NEB config.

[bosecorp]

I did it in the worker config

the problem is that sometimes the queue builds up and stays high and doesn't go down for a considerable amount of time. it doesn't seem to be able to catch up

[bheden]

Open up your NEB config, (/etc/mod_gearman/mod_gearman_neb.conf for ModGearman v1 or /etc/mod_gearman2/module.conf for ModGearman v2) and find the line that says

Code: Select all

result_workers=1

Change this line to

Code: Select all

result_workers=2

Let us know if this stops the hang ups. Thanks.

[bosecorp]

I already had that setting. I am having at some point in the past I made that change.


for the last two days the queues have been stable

[tmcdonald]

It's hard to say what's causing the queue to go up, but generally this will happen when there is a network outage and many hosts/services go down at once. This causes checks to be run more frequently, usually from every 5 minutes down to every minute. Do the jumps in the queue coincide with any network events you can identify?

[bosecorp]

I haven't been good at capturing the different events. i will start..

queue has been good for the last few days.

this is so weird

[rkennedy]

Sounds good - let us know if there is any further assistance you need from us.