Nagios XI all checks in Pending

[morabanc]

Hi,

From 6 hours ago we have all checks in pending state, we restarted the service and de system and is in de same pending state.

In the admin zone of nagios XI at Component Status we have all services ok, but Database Maintanence in Critical (Last chech 7h ago), Feed Processor in Critical (Last run 7h ago), System Statistics (Last update 7h ago).

In the nagios.log file the last lines say:

[1367723696] Error: my_fcopy() failed to write to '/usr/local/nagios/var/spool/checkresults/casik7Z': No space left on device
[1367723696] Error: my_fcopy() failed to write to '/usr/local/nagios/var/spool/checkresults/czBsdMZ': No space left on device
[1367723696] Error: my_fcopy() failed to write to '/usr/local/nagios/var/spool/checkresults/cD3A4tZ': No space left on device
[1367723696] Error: Unable to rename file '/tmp/checkceU1KZ' to '/usr/local/nagios/var/spool/checkresults/czBsdMZ': No space left on device
[1367723696] Error: Unable to rename file '/tmp/checkMwrSsZ' to '/usr/local/nagios/var/spool/checkresults/cD3A4tZ': No space left on device
[1367723696] Error: Unable to rename file '/tmp/checknGJ85Z' to '/usr/local/nagios/var/spool/checkresults/casik7Z': No space left on device
[1367723696] Warning: Unable to move file '/tmp/checkceU1KZ' to check results queue.
[1367723696] Warning: Unable to move file '/tmp/checkMwrSsZ' to check results queue.
[1367723696] Warning: Unable to move file '/tmp/checknGJ85Z' to check results queue.
[1367723696] Error: my_fcopy() failed to write to '/usr/local/nagios/var/spool/checkresults/cAJohjZ': No space left on device
[1367723696] Error: Unable to rename file '/tmp/checkk0kAgZ' to '/usr/local/nagios/var/spool/checkresults/cAJohjZ': No space left on device
[1367723696] Warning: Unable to move file '/tmp/checkk0kAgZ' to check results queue.

But we have enought space in disk...

[xxxx@nagiosxi ~]$ df -k
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_00-lv_root
10321208 9853732 0 100% /
tmpfs 1962184 0 1962184 0% /dev/shm
/dev/sda1 247919 88270 146849 38% /boot
/dev/mapper/vg_00-lv_home
10321208 735564 9061356 8% /home
/dev/mapper/vg_00-lv_tmp
5934672 53176 5580092 1% /tmp
/dev/mapper/vg_00-lv_var
24770940 6966304 16546628 30% /var
/dev/mapper/vg_00-lv_var_log
4128448 505616 3413144 13% /var/log
/dev/mapper/vg_00-lv_var_log_audit
4128448 1993164 1925596 51% /var/log/audit

We deleted all files in /usr/local/nagios/var/spool/checkresults/
We fixed all database errors in Mysql...

The Nagios now its in redhat machine virtualized over vmware
Linux nagiosxi 2.6.32-220.17.1.el6.x86_64 #1 SMP Thu Apr 26 13:37:13 EDT 2012 x86_64 x86_64 x86_64 GNU/Linux

Well we need support urgently.

[scottwilkerson]

Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_00-lv_root 10321208 9853732 0 100% /

this means your root partition is full (100% Use%)

If this is a VM here's a document outlining increasing the space
http://library.nagios.com/library/produ ... -disk-size