Page 3 of 3
Re: Engine hosed after network disconnect
Posted: Thu Oct 10, 2013 12:45 pm
by abrist
vAJ wrote:OK. Log rotation is good at 24hrs now.
Great.
How does the disk cache look?
Re: Engine hosed after network disconnect
Posted: Thu Oct 10, 2013 12:58 pm
by vAJ
holding nicely at 1.1GB.
Code: Select all
total used free shared buffers cached
Mem: 24013 1727 22285 0 93 467
-/+ buffers/cache: 1166 22846
Swap: 10239 0 10239
Re: Engine hosed after network disconnect
Posted: Thu Oct 10, 2013 12:59 pm
by vAJ
Nevermind. This box was just rebooted. Remote hands at datacenter got the wrong box about 2hrs ago...
Can you tell I'm having a good week?
Re: Engine hosed after network disconnect
Posted: Thu Oct 10, 2013 1:13 pm
by slansing
Yikes... What does that mean for your current situation?
Re: Engine hosed after network disconnect
Posted: Thu Oct 10, 2013 1:38 pm
by vAJ
Honestly, I don't know. This is not an easily replicable problem.
None of the logs have clearly shown any issues. The nagios logs are verbose and the NOC can't give me a good window when they noticed it was hosed. I know when I was woken up to restart it. but there's nothing in the logs around that time.
And, we're highly unlikely to see the issue again as the network re-architecture has been completed for this site. might just need to close this thread and if it ever happens again, I'll have a script ready for the NOC to run to dump the logs out and capture a few other metrics.
Re: Engine hosed after network disconnect
Posted: Thu Oct 10, 2013 4:36 pm
by abrist
Sounds like a plan. We like closing threads. Keep an ear to the ground and let us know if the issue recurs.