Ndo2db stop checks on nagiosxi

[nagarjuna]

Hi Team,

Every 2-3 hours monitoring engine running and automatically stopped checks, and getting error from /var/log/messages.

Dec 31 15:14:13 NagiosxiApp ndo2db: Error: max retries exceeded sending message to queue. Kernel queue parameters may neeed to be tuned. See README.
Dec 31 15:14:13 NagiosxiApp ndo2db: Warning: queue send error, retrying...
Dec 31 15:14:33 NagiosxiApp ndo2db: Error: max retries exceeded sending message to queue. Kernel queue parameters may neeed to be tuned. See README.
Dec 31 15:14:33 NagiosxiApp ndo2db: Warning: queue send error, retrying...
Dec 31 15:14:53 NagiosxiApp ndo2db: Error: max retries exceeded sending message to queue. Kernel queue parameters may neeed to be tuned. See README.
Dec 31 15:14:53 NagiosxiApp ndo2db: Warning: queue send error, retrying...

after running ndo2db service its starting checks.

please help us .....

[scottwilkerson]

This is likely related to kernel tuning.

Please see this FAQ
http://support.nagios.com/wiki/index.ph ... 3.x_Issues

[nagarjuna]

Hi Team,

Can you suggest us for 3500 host and 22000 services with 5 min interval and 8 min for freshness check, what will be good parameters for this or we need to observe and then we can only understand.

My question is max value what we can put here for all "msg" in /etc/sysctl.conf file.

[slansing]

I would start with the values outlined in the FAQ section that Scott posted, and if they are still too low (which they should not be) they can be adjusted by some basic factoring from there on out.

[nagarjuna]

Hi Team,

We have adjusted whatever mentioned in

Please see this FAQ
http://support.nagios.com/wiki/index.ph ... 3.x_Issues

But it seems very low every 15-20 min checks stopped whenever we are not starting ndo2db service, its showing 5000 messages clear from queue.

As i mentioned we have 3500 hosts with 22000 services.

[abrist]

Did you restart the server? Ulimit changes require a restart. What values did you set? Just the suggested ones from the faq?

[nagarjuna]

Hi abrist,

We did not restart after changing any set of parameters only we have given sysctl -p for update from /etc/sysctl.conf. Following values we have set in /etc/sysctl.conf file. Please check

# sysctl -p

kernel.msgmnb = 131072000
kernel.msgmax = 131072000
kernel.shmmax = 4294967295
kernel.shmall = 268435456
kernel.msgmni = 256000

What are the maximum limits for above parameters in Centos-6.3 64 bit

[abrist]

What have you set for ulimits?

Code: Select all

ulimit -a

[nagarjuna]

Hi Abrist,

Please check the following ....

[root@NagiosxiApp ~]# ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 321340
max locked memory (kbytes, -l) 128
max memory size (kbytes, -m) unlimited
open files (-n) 20480
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 20480
cpu time (seconds, -t) unlimited
max user processes (-u) unlimited
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[root@NagiosxiApp ~]#

[abrist]

Ok. Is this in relation to a current open ticket? If so, we should just deal with it through the ticketing system.