Nagios LS stops working after a week or so...

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
GacoAdmin110
Posts: 33
Joined: Mon Aug 31, 2015 1:30 pm

Nagios LS stops working after a week or so...

Post by GacoAdmin110 »

9-24-2015 12-26-36 PM.jpg
I have created a VM for the log server 3 times now, and every VM that I have created dies after a week or so of running.

Everything is running fine on them, and all of a sudden the web portal gives a service elasticsearch restart error.

When I go to the VM this is what I see.

Anyone run into it before?

Thnx

Mike
You do not have the required permissions to view the files attached to this post.
User avatar
eloyd
Cool Title Here
Posts: 2190
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: Nagios LS stops working after a week or so...

Post by eloyd »

Need details. Like how much memory are you allocating, how many CPUs, how many cores? I'm guessing you're running out of memory.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoyd
I'm a Nagios Fanatic! • Join our public Nagios Discord Server!
User avatar
hsmith
Agent Smith
Posts: 3539
Joined: Thu Jul 30, 2015 11:09 am
Location: 127.0.0.1
Contact:

Re: Nagios LS stops working after a week or so...

Post by hsmith »

To expand on what @eloyd said, can we please get the output of df -ih and df -h?
Former Nagios Employee.
me.
GacoAdmin110
Posts: 33
Joined: Mon Aug 31, 2015 1:30 pm

Re: Nagios LS stops working after a week or so...

Post by GacoAdmin110 »

2 cpus, 4GB RAM, 128GB hdd

Thnx
GacoAdmin110
Posts: 33
Joined: Mon Aug 31, 2015 1:30 pm

Re: Nagios LS stops working after a week or so...

Post by GacoAdmin110 »

I just tried 4cpus, 8GB ram...still no luck
GacoAdmin110
Posts: 33
Joined: Mon Aug 31, 2015 1:30 pm

Re: Nagios LS stops working after a week or so...

Post by GacoAdmin110 »

9-24-2015 1-22-12 PM.jpg
I am guessing I filled the hdd...funny how I allocated 128GB but it only sees 100GB of it...anyone know the commands to expand the hdd?

Must be something about the log retention that I will have to shorten I am guessing.
You do not have the required permissions to view the files attached to this post.
User avatar
eloyd
Cool Title Here
Posts: 2190
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: Nagios LS stops working after a week or so...

Post by eloyd »

Are you asking how to expand the disk at the VM host level or the VM guest level? If it's VM host, then I'd suggest http://kb.vmware.com/selfservice/micros ... Id=1004047

Expanding the guest disk space would be easily done with a quick Google search.
Last edited by eloyd on Thu Sep 24, 2015 1:27 pm, edited 1 time in total.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoyd
I'm a Nagios Fanatic! • Join our public Nagios Discord Server!
GacoAdmin110
Posts: 33
Joined: Mon Aug 31, 2015 1:30 pm

Re: Nagios LS stops working after a week or so...

Post by GacoAdmin110 »

hsmith wrote:To expand on what @eloyd said, can we please get the output of df -ih and df -h?
Here is what I found by the way...see above
GacoAdmin110
Posts: 33
Joined: Mon Aug 31, 2015 1:30 pm

Re: Nagios LS stops working after a week or so...

Post by GacoAdmin110 »

eloyd wrote:Are you asking how to expand the disk at the VM host level or the VM guest level? If it's VM host, then I'd suggest http://kb.vmware.com/selfservice/micros ... Id=1004047
VM I know...just wondering if there is a way inside the Nagios guest OS to expand
User avatar
eloyd
Cool Title Here
Posts: 2190
Joined: Thu Sep 27, 2012 9:14 am
Location: Rochester, NY
Contact:

Re: Nagios LS stops working after a week or so...

Post by eloyd »

IF you have additional unallocated space available to the VM guest, then you should be able to resize the partition via resize2fs.

It may be easier to start over and either increase VM host virtual disk size or you may be able to add a second disk now for /var/log mount point.
Image
Eric Loyd • http://everwatch.global • 844.240.EVER • @EricLoyd
I'm a Nagios Fanatic! • Join our public Nagios Discord Server!
Locked