Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
Honestly, I don't know. This is not an easily replicable problem.
None of the logs have clearly shown any issues. The nagios logs are verbose and the NOC can't give me a good window when they noticed it was hosed. I know when I was woken up to restart it. but there's nothing in the logs around that time.
And, we're highly unlikely to see the issue again as the network re-architecture has been completed for this site. might just need to close this thread and if it ever happens again, I'll have a script ready for the NOC to run to dump the logs out and capture a few other metrics.
Sounds like a plan. We like closing threads. Keep an ear to the ground and let us know if the issue recurs.
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.