Code: Select all
tail -n100 /var/log/mysqld.log
Code: Select all
tail -n100 /var/log/mysqld.log
rkennedy wrote:Let's check out the mysql log file. Can you run the following command and post the output?Code: Select all
tail -n100 /var/log/mysqld.log
Code: Select all
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:25 InnoDB: Started; log sequence number 0 229406
160108 10:32:25 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:25 [ERROR] Can't start server: can't create PID file: No space left on device
160108 10:32:25 mysqld_safe Number of processes running now: 0
160108 10:32:25 mysqld_safe mysqld restarted
160108 10:32:25 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:25 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:25 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:26 InnoDB: Started; log sequence number 0 229406
160108 10:32:26 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:26 [ERROR] Can't start server: can't create PID file: No space left on device
160108 10:32:26 mysqld_safe Number of processes running now: 0
160108 10:32:26 mysqld_safe mysqld restarted
160108 10:32:26 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:26 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:26 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:26 InnoDB: Started; log sequence number 0 229406160108 10:32:55 mysqld_safe Number of processes running now: 0
160108 10:32:55 mysqld_safe mysqld restarted
160108 10:32:55 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:55 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:55 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:55 InnoDB: Started; log sequence number 0 229406
160108 10:32:55 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:55 [ERROR] Can't start server: can't create PID file: No space left on device
160108 10:32:55 mysqld_safe Number of processes running now: 0
160108 10:32:55 mysqld_safe mysqld restarted
160108 10:32:55 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:55 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:55 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:55 InnoDB: Started; log sequence number 0 229406
160108 10:32:55 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:55 [ERROR] Can't start server: can't create PID file: No space left on device
160108 10:32:55 mysqld_safe Number of processes running now: 0
160108 10:32:55 mysqld_safe mysqld restarted
160108 10:32:55 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:55 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:55 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:55 InnoDB: Started; log sequence number 0 229406
160108 10:32:55 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:55 [ERROR] Can't start server: can't create PID file: No space left on device
160108 10:32:55 mysqld_safe Number of processes running now: 0
160108 10:32:55 mysqld_safe mysqld restarted
160108 10:32:55 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:55 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:55 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:56 InnoDB: Started; log sequence number 0 229406
160108 10:32:56 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:56 [ERROR] Can't start server: can't create PID file: No space left on device
160108 10:32:56 mysqld_safe Number of processes running now: 0
160108 10:32:56 mysqld_safe mysqld restarted
160108 10:32:56 InnoDB: Initializing buffer pool, size = 8.0M
160108 10:32:56 InnoDB: Completed initialization of buffer pool
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
160108 10:32:56 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
160108 10:32:56 InnoDB: Started; log sequence number 0 229406Code: Select all
160108 10:32:25 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28)
160108 10:32:25 [ERROR] Can't start server: can't create PID file: No space left on device
rkennedy wrote:This stands out as you may have ran out of disk space, what is the result of df -H?Code: Select all
160108 10:32:25 [ERROR] /usr/libexec/mysqld: Error writing file '/var/run/mysqld/mysqld.pid' (Errcode: 28) 160108 10:32:25 [ERROR] Can't start server: can't create PID file: No space left on device
Code: Select all
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup-lv_root
7.9G 7.9G 0 100% /
tmpfs 2.1G 0 2.1G 0% /dev/shm
/dev/sda1 500M 75M 399M 16% /boot
[root@nagiosfe /]#

Ok, thanks.rkennedy wrote:Take a look at this document for information on resizing the VM disk - https://assets.nagios.com/downloads/nag ... M-Disk.pdf
The files that grow in Nagios shouldn't be growing by very much every day to be honest. You can always tweak certain programs to not log which would stop space from being used.