I've been experiencing this problem. It started about 6 weeks ago the CPU load started to increase (as did memory usage) and then suddenly for no apparent reason my primary nagios server failed over to the secondary (I use keepalived and some custom scripts to have active/passive nodes). And I was seeing the fork error in the logs. Since I hadn't patched the host since it was built a year earlier I installed all the latest patches and gave it a reboot. This seemed to fix the issues until yesterday when the CPU load is creeping up again as is the memory. Currently using 59GB memory of 96GB for 550 hosts and 2400 services.
Watching htop I see my jmx service checks are eating CPU and memory as well as httpd and mysql.
One of my biggest concerns is false page-outs because of check timeouts.
OS: CentOS 6.4 (Final)
Nagios: 2012R2.1 (planning on upgrading to 2012R2.5 soon)
PHP Version: 5.3.3
performance issues, fork error
Re: performance issues, fork error
@westernuniv: You will need to increase the ulimits:
http://support.nagios.com/wiki/index.ph ... g_Orphaned
http://support.nagios.com/wiki/index.ph ... g_Orphaned
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
-
westernuniv
- Posts: 120
- Joined: Tue Aug 21, 2012 9:29 am
Re: performance issues, fork error
That seems to have fixed the problem. Thanks