Frequent database connection error

[mejokj]

[root@NMSAPPSERVER1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_nmsappserver1-lv_root 50G 15G 33G 31% /
tmpfs 7.4G 0 7.4G 0% /dev/shm
/dev/sda1 485M 50M 410M 11% /boot
/dev/mapper/vg_nmsappserver1-lv_home 61G 8.3G 50G 15% /home



[root@NMSAPPSERVER1 ~]# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/mapper/vg_nmsappserver1-lv_root 3276800 96598 3180202 3% /
tmpfs 160572 1 160571 1% /dev/shm
/dev/sda1 128016 44 127972 1% /boot
/dev/mapper/vg_nmsappserver1-lv_home 4038656 13721 4024935 1% /home

[tgriep]

Could you post the following file from your Nagios server so we can review it?
/etc/my.cnf

[mejokj]

[root@NMSAPPSERVER1 ~]# cat /etc/my.cnf
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
user=mysql
set-variable=max_connections=500
interactive_timeout=60
slow_query_log = 1
slow_query_log = /var/log/mysqlslow.log

key_buffer_size = 256M
query_cache_size = 8M
tmp_table_size = 16M
max_heap_table_size = 16M
thread_cache_size = 4
table_open_cache = 64


# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0

[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

[tgriep]

Could you remove these settings from your /etc/my.cnf file and restart mysql to see if it fixes the issue?

Code: Select all

set-variable=max_connections=500
interactive_timeout=60
slow_query_log = 1
slow_query_log = /var/log/mysqlslow.log

key_buffer_size = 256M
query_cache_size = 8M
tmp_table_size = 16M
max_heap_table_size = 16M
thread_cache_size = 4
table_open_cache = 64 

Also, could you run the following and post back the results?

Code: Select all

ipcs -q
/usr/local/nagios/bin/ndo2db -V

[mejokj]

I remember making those change to my.cnf after I noticed the DB was very slow. I have now removed the lines you mentioned.


Output of other commands:

[root@NMSAPPSERVER1 ~]# ipcs -q

------ Message Queues --------
key msqid owner perms used-bytes messages
0x78000002 98304 nagios 600 131072000 128000
0xdd000002 786433 nagios 600 0 0



[root@NMSAPPSERVER1 ~]# /usr/local/nagios/bin/ndo2db -V

NDO2DB 2.0.0
Copyright (c) 2009 Nagios Core Development Team and Community Contributors
Copyright (c) 2005-2008 Ethan Galstad
Last Modified: 02-28-2014
License: GPL v2

Stores Nagios event and configuration data to a database for later retrieval
and processing. Clients that are capable of sending data to the NDO2DB daemon
include the LOG2NDO utility and NDOMOD event broker module.

Usage: /usr/local/nagios/bin/ndo2db -c <config_file> [-i]

-i = Run under INETD/XINETD.

[lmiltchev]

We've seen a few other users with similar issues. I suspect this could be a bug. Can you run the following commands and show us the output:

Code: Select all

uname -a
cat /etc/*release

We are going to pass the into to our developers, who are already looking into this.

[mejokj]

[root@NMSAPPSERVER1 ~]# uname -a
Linux NMSAPPSERVER1 2.6.32-431.29.2.el6.i686 #1 SMP Tue Sep 9 20:14:52 UTC 2014 i686 i686 i386 GNU/Linux


[root@NMSAPPSERVER1 ~]# cat /etc/*release
CentOS release 6.5 (Final)
CentOS release 6.5 (Final)
CentOS release 6.5 (Final)

[tmcdonald]

Would you be willing to open a ticket for this? Myself and one of the Core developers think this is related to ndo and I have some ideas on how to troubleshoot, but it will require a remote session (or a few).

If you are okay with opening a ticket, please email [email protected] with a link to this thread, a descriptive subject, and a short summary of the current state of the problem.

[mejokj]

Just did, thanks!

[lmiltchev]

You opened a new support ticket in our email ticketing system. We will continue communicating via emails. I am locking this topic.