Logs stop coming in

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Logs stop coming in

Post by scottwilkerson »

Did you make the change to the heap above on all of the machines in your cluster?
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
myriad
Posts: 26
Joined: Tue Dec 02, 2014 1:29 pm

Re: Logs stop coming in

Post by myriad »

Yes, I made the heap change. Servers just crashed now. they can't last longer than 12 hours without a reboot. And when they crash, logs stop inputting, and on the restart the database has to resync (or something happens) so I get this big bandwidth consumption.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Logs stop coming in

Post by scottwilkerson »

What setting did you use for the HEAP?

How much RAM does each server have?

Did you adhere to only allocating 1/2 of the physical RAM to the HEAP?
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
myriad
Posts: 26
Joined: Tue Dec 02, 2014 1:29 pm

Re: Logs stop coming in

Post by myriad »

servers have 2GB ram, heap size 1GB
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Logs stop coming in

Post by scottwilkerson »

myriad wrote:servers have 2GB ram, heap size 1GB
Based on the volumes of logs you are sending (per your screenshots) I would suggest at least 4X that amount of RAM in each of your servers.
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
myriad
Posts: 26
Joined: Tue Dec 02, 2014 1:29 pm

Re: Logs stop coming in

Post by myriad »

I've updated the three servers to 16GB ram and set the heap to 8GB. it worked for 6 days then failed sometime this morning before I got to work.
sreinhardt
-fno-stack-protector
Posts: 4366
Joined: Mon Nov 19, 2012 12:10 pm

Re: Logs stop coming in

Post by sreinhardt »

Let's apply the patch as I outlined here, it seems that you are getting similar if not identical issues.

http://support.nagios.com/forum/viewtop ... er#p122363
Nagios-Plugins maintainer exclusively, unless you have other C language bugs with open-source nagios projects, then I am happy to help! Please pm or use other communication to alert me to issues as I no longer track the forum.
myriad
Posts: 26
Joined: Tue Dec 02, 2014 1:29 pm

Re: Logs stop coming in

Post by myriad »

Thank you! So far the systems have been working since I've applied the suggested patch above.
tmcdonald
Posts: 9117
Joined: Mon Sep 23, 2013 8:40 am

Re: Logs stop coming in

Post by tmcdonald »

I'd like to close this now, but I want to confirm whether your account "myriad" is the same as "globalgiving". Can you post back as globalgiving and confirm one way or the other?
Former Nagios employee
myriad
Posts: 26
Joined: Tue Dec 02, 2014 1:29 pm

Re: Logs stop coming in

Post by myriad »

it's Myriad, I'm still having other issues as posted on other topics, but can close this one now.
Locked