Nagios server memory use

[gormank]

I haven't investigated this very far for gearman, but I see the memory is used by dentry in slabtop. Note that buffer_head is using vastly less memory.

Code: Select all

  OBJS ACTIVE  USE OBJ SIZE  SLABS OBJ/SLAB CACHE SIZE NAME
151664260 151664260  15%    0.19K 7583213       20  30332852K dentry
3175266 3171808  99%    0.10K  85818       37    343272K buffer_head

Some searching suggests this might resolve the issue if something is using NSS. Curl is mentioned specifically, but I'd guess anything using NSS similarly would have the same issue.

Bug 1044666 - Can curl HTTPS requests make fewer access system calls?
https://bugzilla.redhat.com/show_bug.cgi?id=1044666

Bug 956082 - Avoid call to sdb_measureAccess in lib/softoken/sdb.c s_open if NSS_SDB_USE_CACHE is "yes" or "no"
https://bugzilla.mozilla.org/show_bug.cgi?id=956082

[tmcdonald]

I'm going to see if @bheden can take a look at this when we get back in tomorrow since he's much more familiar with the inner workings of mod_gearman and has some C background. If you don't hear back by noon or so (Central) feel free to bump this.

[bheden]

Did you ever upgrade?

Did you ever disable the old ModGearman broker module?

[gormank]

No and no. :)

[tmcdonald]

Is upgrading/disabling not an option, or just haven't gotten around to it? Bryan's probably one of the most knowledgeable people on the team when it comes to mod_gearman, so I'm deferring to his advice on this one.

[gormank]

I just haven't gotten around to it. I have test systems now so I can verify the steps, but it has troubles that take priority over this. Its actually NRPE/nsclient that needs installed on hosts that's the trouble on that end.
Waiting for that advice...

[tmcdonald]

I'm referring to his advice (maybe wasn't obviously worded as such) to upgrade from the previous page:

I rewrote the ModGearman install script to install/upgrade automatically and copy the necessary configuration files over.

This is still in testing, but has passed all of our internal tests so far.

If you'd like to give it a go (with the caveat of supplying feedback, of course), the URL is:

http://assets.nagios.com/downloads/nagi ... Install.sh

On your server:

Code: Select all

wget http://assets.nagios.com/downloads/nagiosxi/scripts/ModGearmanInstall.sh
chmod +x ModGearmanInstall.sh
./ModGearmanInstall.sh --server --upgrade

And then follow the prompts. This *should* remove (or ignore) all gearman installs and install the new ones and set them up to be used by Nagios.

It will prompt you for configuration file locations - make sure they are correct before continuing.

Having a good known backup before hand is a good idea, too.