Page 5 of 5
Re: Nagios server memory use
Posted: Thu Jun 02, 2016 3:17 pm
by gormank
I haven't investigated this very far for gearman, but I see the memory is used by dentry in slabtop. Note that buffer_head is using vastly less memory.
Code: Select all
OBJS ACTIVE USE OBJ SIZE SLABS OBJ/SLAB CACHE SIZE NAME
151664260 151664260 15% 0.19K 7583213 20 30332852K dentry
3175266 3171808 99% 0.10K 85818 37 343272K buffer_head
Some searching suggests this might resolve the issue if something is using NSS. Curl is mentioned specifically, but I'd guess anything using NSS similarly would have the same issue.
Bug 1044666 - Can curl HTTPS requests make fewer access system calls?
https://bugzilla.redhat.com/show_bug.cgi?id=1044666
Bug 956082 - Avoid call to sdb_measureAccess in lib/softoken/sdb.c s_open if NSS_SDB_USE_CACHE is "yes" or "no"
https://bugzilla.mozilla.org/show_bug.cgi?id=956082
Re: Nagios server memory use
Posted: Thu Jun 02, 2016 5:11 pm
by tmcdonald
I'm going to see if
@bheden can take a look at this when we get back in tomorrow since he's much more familiar with the inner workings of mod_gearman and has some C background. If you don't hear back by noon or so (Central) feel free to bump this.
Re: Nagios server memory use
Posted: Fri Jun 03, 2016 9:11 am
by bheden
Did you ever upgrade?
Did you ever disable the old ModGearman broker module?
Re: Nagios server memory use
Posted: Fri Jun 03, 2016 11:53 am
by gormank
No and no. :)
Re: Nagios server memory use
Posted: Fri Jun 03, 2016 2:15 pm
by tmcdonald
Is upgrading/disabling not an option, or just haven't gotten around to it? Bryan's probably one of the most knowledgeable people on the team when it comes to mod_gearman, so I'm deferring to his advice on this one.
Re: Nagios server memory use
Posted: Fri Jun 03, 2016 2:23 pm
by gormank
I just haven't gotten around to it. I have test systems now so I can verify the steps, but it has troubles that take priority over this. Its actually NRPE/nsclient that needs installed on hosts that's the trouble on that end.
Waiting for that advice...
Re: Nagios server memory use
Posted: Fri Jun 03, 2016 2:26 pm
by tmcdonald
I'm referring to his advice (maybe wasn't obviously worded as such) to upgrade from the previous page:
bheden wrote:I rewrote the ModGearman install script to install/upgrade automatically and copy the necessary configuration files over.
This is still in testing, but has passed all of our internal tests so far.
If you'd like to give it a go (with the caveat of supplying feedback, of course), the URL is:
http://assets.nagios.com/downloads/nagi ... Install.sh
On your server:
Code: Select all
wget http://assets.nagios.com/downloads/nagiosxi/scripts/ModGearmanInstall.sh
chmod +x ModGearmanInstall.sh
./ModGearmanInstall.sh --server --upgrade
And then follow the prompts. This *should* remove (or ignore) all gearman installs and install the new ones and set them up to be used by Nagios.
It will prompt you for configuration file locations - make sure they are correct before continuing.
Having a good known backup before hand is a good idea, too.