Hosts loosing connection.
Posted: Wed Mar 21, 2012 9:45 am
Hi!
Im having a Nagios server for monitoring alot of win 2003 & win 2008 servers, both in the local network and outside my network.
This has worked perfectly without any problems what so ever till a few weeks ago.
Every night at 4am to aprox 5 am some of my hosts are loosing its connection at the same time. Rest of the day it works fine.
So i've checked the nagios log and couldnt find anything intresting so i checked the client side,
Im using nsclient++ via NSCA to monitor my hosts and when i check the log i saw that this message appears at the same time 4am to 5am.
So of course i checked the socket_timeout and it was set to 0 so i changed it to 30, restarted the services and waited untill next day. Same message appears.
I want to make clear that this does not affect all the hosts just some of them. and its the same hosts every night.
Anyone know what i can do?
Im having a Nagios server for monitoring alot of win 2003 & win 2008 servers, both in the local network and outside my network.
This has worked perfectly without any problems what so ever till a few weeks ago.
Every night at 4am to aprox 5 am some of my hosts are loosing its connection at the same time. Rest of the day it works fine.
So i've checked the nagios log and couldnt find anything intresting so i checked the client side,
Im using nsclient++ via NSCA to monitor my hosts and when i check the log i saw that this message appears at the same time 4am to 5am.
Code: Select all
2012-03-21 04:03:02: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:03:34: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:04:06: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:04:38: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:05:10: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:05:42: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:06:14: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:06:46: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:07:18: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:07:50: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:08:22: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:08:54: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:09:26: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:09:58: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:10:30: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:11:02: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:11:34: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:12:06: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:12:38: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:13:10: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:13:42: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:14:14: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:14:46: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:15:18: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:15:50: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:16:22: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:16:54: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:17:26: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:17:58: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:18:30: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:19:02: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:19:34: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:20:06: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:20:38: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:21:10: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:21:42: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:22:14: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:22:46: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:23:18: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:24:22: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:24:54: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:25:26: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:25:58: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:26:30: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:27:01: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:27:33: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:28:05: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:28:37: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:29:09: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:29:41: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:30:13: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:30:45: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:31:17: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:31:49: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:32:21: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:32:53: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:33:25: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:33:57: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:34:29: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:35:01: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:35:33: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:36:05: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:42:32: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:45:43: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:47:38: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0
2012-03-21 04:48:10: error:modules\NSCAAgent\NSCAThread.cpp:301: Timeout reading NSCA hdr packet (increase socket_timeout), we only got: 0So of course i checked the socket_timeout and it was set to 0 so i changed it to 30, restarted the services and waited untill next day. Same message appears.
I want to make clear that this does not affect all the hosts just some of them. and its the same hosts every night.
Anyone know what i can do?