Page 2 of 2

Re: Performance Graph missing

Posted: Fri Aug 29, 2014 6:45 am
by rajasegar
abrist wrote:RPM was sent through email (ticket system).
The new mod gearman beta fixed all the \n issues. So far it seems everything is fine.
It is generating crazy amount of logs. Please advice how to turn it off. All the debug is at 0

Code: Select all

[nagios@nagiosdevxi1 mod_gearman]$ ls -lh /var/log/mod_gearman/
total 13G
-rw-r--r-- 1 nagios nagios 1.7G Aug 29 19:52 mod_gearman_neb.log
-rw-rw-r-- 1 nagios nagios  11G Aug 29 19:53 mod_gearman_worker.log
[nagios@nagiosdevxi1 mod_gearman]$

However I am not sure what to check to ensure all is ok.

Re: Performance Graph missing

Posted: Fri Aug 29, 2014 10:21 am
by slansing
Holy smokes those are huge, I've not seen that before. Are you sure that was not prior to installing the beta version? That would be an insane amount of information gathering done in a 24 hour period. Do you see anything being repeated in those logs? How many checks are you running through gearman, and at what interval? Do you have:

Code: Select all

workaround_rc_25=off
Turned off in your:

Code: Select all

/etc/mod_gearman/mod_gearman_worker.conf
It would be nice if we could see a snippet of those logs, maybe 100 lines or so each.

Re: Performance Graph missing

Posted: Mon Sep 01, 2014 1:10 am
by rajasegar
slansing wrote:Holy smokes those are huge, I've not seen that before. Are you sure that was not prior to installing the beta version? That would be an insane amount of information gathering done in a 24 hour period. Do you see anything being repeated in those logs? How many checks are you running through gearman, and at what interval? Do you have:

Code: Select all

workaround_rc_25=off
Turned off in your:

Code: Select all

/etc/mod_gearman/mod_gearman_worker.conf
It would be nice if we could see a snippet of those logs, maybe 100 lines or so each.
That logs was from dev which has about 25 hosts and 200 services check.
Not sure if it was there before the beta installation.
I restarted it and it is seems to be fine.
The workaround setting was in off setting.

See attached 10000 lines extract of the oversized files


This is from production which is not using the beta

Code: Select all

[nagios@nagiosprodxi1 mod_gearman]$ ls -lhrt *
-rw-r--r-- 1 nagios nagios 1.1K Jul 24 08:54 mod_gearman_neb_20140724_08:53:57.log
-rw-rw-r-- 1 nagios nagios  54K Jul 24 09:01 mod_gearman_worker_20140724_09:02:00.log
-rw-r--r-- 1 root   root      0 Jul 31 07:15 mod_gearman_neb_20140731_07:28:21.log
-rw-r--r-- 1 root   root      0 Jul 31 07:15 mod_gearman_worker_20140731_07:23:10.log
-rw-rw-r-- 1 nagios nagios  147 Jul 31 07:18 mod_gearman_neb_20140731_07:15:38.log
-rw-r--r-- 1 nagios nagios  13K Jul 31 07:18 mod_gearman_worker_20140731_07:15:39.log
-rw-r--r-- 1 root   root      0 Jul 31 07:23 mod_gearman_worker_20140731_07:23:21.log
-rw-r--r-- 1 root   root      0 Jul 31 07:23 mod_gearman_worker_20140731_07:24:16.log
-rw-r--r-- 1 root   root      0 Jul 31 07:28 mod_gearman_neb_20140731_07:30:50.log
-rw-r--r-- 1 root   root      0 Jul 31 07:30 mod_gearman_neb.log
-rw-r--r-- 1 root   root      0 Jul 31 07:30 mod_gearman_neb_20140731_07:30:30.log
-rw-rw-r-- 1 nagios nagios 2.9M Sep  1 13:48 mod_gearman_worker.log

gearman_log_extract.zip

Re: Performance Graph missing

Posted: Tue Sep 02, 2014 1:57 pm
by abrist
Can you post the following files? I think you need to turn down the logging level:

Code: Select all

/etc/mod_gearman/mod_gearman_neb.conf
/etc/mod_gearman/mod_gearman_worker.conf

Re: Performance Graph missing

Posted: Tue Sep 02, 2014 5:56 pm
by rajasegar
abrist wrote:Can you post the following files? I think you need to turn down the logging level:

Code: Select all

/etc/mod_gearman/mod_gearman_neb.conf
/etc/mod_gearman/mod_gearman_worker.conf
mod_gearman_worker.conf
mod_gearman_neb.conf

Re: Performance Graph missing

Posted: Wed Sep 03, 2014 10:30 am
by lmiltchev
The debug is set to zero in both files - the least verbosity you can set... Are you still getting tons of logs generated? Can you run the following command and show us the output?

Code: Select all

ll -th /var/log/mod_gearman | head -10

Re: Performance Graph missing

Posted: Wed Sep 03, 2014 6:05 pm
by rajasegar
lmiltchev wrote:The debug is set to zero in both files - the least verbosity you can set... Are you still getting tons of logs generated? Can you run the following command and show us the output?

Code: Select all

ll -th /var/log/mod_gearman | head -10
It is fine now. Don't know how it generated all the logs earlier.

Re: Performance Graph missing

Posted: Thu Sep 04, 2014 9:15 am
by tmcdonald
Should we keep the thread open for a bit or do you think we're all set to close it?

Re: Performance Graph missing

Posted: Thu Sep 04, 2014 5:59 pm
by rajasegar
tmcdonald wrote:Should we keep the thread open for a bit or do you think we're all set to close it?
Please close the thread. Thanks