Backup directory consuming large amounts of disk space

[tgriep]

Lets set the permissions on that check manually. Please run the following to do that.

Code: Select all

chmod 755 /usr/local/nagios/libexec/check_services
chown nagios.nagios /usr/local/nagios/libexec/check_services

Could you run the following and post is so we can see if there are any more permission issues on those files in that folder?

Code: Select all

ls -l /usr/local/nagios/libexec/

[jkinning]

Code: Select all

ls -l /usr/local/nagios/libexec/
total 8984
-rw-r--r-- 1 nagios users    1024 Jun 22 12:54 10%
-rw-r--r-- 1 nagios users       0 Jun 22 12:54 20%
-rw-r--r-- 1 nagios users       0 Jun 22 12:13 85%
-rw-r--r-- 1 nagios users    1024 Jun 22 12:13 95%
-rwxr-xr-x 1 root   root   179322 Nov 12  2014 check_apt
-rwxr-xr-x 1 root   root     6897 Dec 25  2014 check_asterisk.pl
-rwxr-xr-x 1 root   root     4173 May 12  2014 check_bl
-rwxr-xr-x 1 root   root     2289 May 12  2014 check_bpi.php
-rwxr-xr-x 1 root   root     2252 Nov 12  2014 check_breeze
-rwxr-xr-x 1 root   root   179747 Nov 12  2014 check_by_ssh
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_clamd -> check_tcp
-rwxr-xr-x 1 root   root   137069 Nov 12  2014 check_cluster
-rwxr-xr-x 1 nagios users     811 Aug  7 14:49 check_curl.sh
-r-sr-xr-x 1 root   root   175386 Nov 12  2014 check_dhcp
-rwxr-xr-x 1 root   root   174477 Nov 12  2014 check_dig
-rwxr-xr-x 1 root   root     3861 Dec 25  2014 check_dir
-rwxr-xr-x 1 root   root   193452 Nov 12  2014 check_disk
-rwxr-xr-x 1 root   root     9290 Nov 12  2014 check_disk_smb
-rwxr-xr-x 1 root   root   189131 Nov 12  2014 check_dns
-rwxr-xr-x 1 nagios users    8026 Jan  2  2015 check_domain.php
-rwxr-xr-x 1 root   root     5144 May 12  2014 check_domain.sh
-rwxr-xr-x 1 root   root    85139 Nov 12  2014 check_dummy
-rwxr-xr-x 1 root   root     5625 May 12  2014 check_em01.pl
-rwxr-xr-x 1 root   root    38345 May 12  2014 check_email_delivery
-rwxr-xr-x 1 root   root    20511 May 12  2014 check_email_delivery_epn
-rwxr-xr-x 1 root   root    20039 Dec 25  2014 check_email_loop.pl
-rwxr-xr-x 1 root   root    82841 May 12  2014 check_esx3.pl
-rwxr-xr-x 1 root   root     3350 Nov 12  2014 check_file_age
-rwxr-xr-x 1 root   root     6316 Nov 12  2014 check_flexlm
-rwxr-xr-x 1 root   root   180845 Nov 12  2014 check_fping
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_ftp -> check_tcp
-rwxr-xr-x 1 root   root     3446 May 12  2014 check_ftp_fully
-rwxr-xr-x 1 root   root   175448 Nov 12  2014 check_hpjd
-rwxr-xr-x 1 root   root   335956 Nov 12  2014 check_http
-r-sr-xr-x 1 root   root   182051 Nov 12  2014 check_icmp
-rwxr-xr-x 1 root   root   146195 Nov 12  2014 check_ide_smart
-rwxr-xr-x 1 root   root      825 May 12  2014 check_ifoperstatnag
-rwxr-xr-x 1 root   root    15124 Nov 12  2014 check_ifoperstatus
-rwxr-xr-x 1 root   root    12601 Nov 12  2014 check_ifstatus
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_imap -> check_tcp
-rwxr-xr-x 1 root   root    35413 May 12  2014 check_imap_receive
-rwxr-xr-x 1 root   root    15576 May 12  2014 check_imap_receive_epn
-rwxr-xr-x 1 root   root     6888 Nov 12  2014 check_ircd
-rwxr-xr-x 1 root   root     2004 Sep 18  2013 check_ironport_deliveryqueue
-rwxr-xr-x 1 root   root     1291 Nov 17  2008 check_ironport_workqueue
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_jabber -> check_tcp
-rwxr-xr-x 1 root   root   157730 Nov 12  2014 check_ldap
lrwxrwxrwx 1 root   root       10 Nov 12  2014 check_ldaps -> check_ldap
-rwxr-xr-x 1 root   root   158124 Nov 12  2014 check_load
-rwxr-xr-x 1 root   root     5989 Nov 12  2014 check_log
-rwxr-xr-x 1 root   root    21481 Nov 12  2014 check_mailq
-rwxr-xr-x 1 root   root    56200 May 12  2014 check_mongodb.py
-rwxr-xr-x 1 root   root   144301 Nov 12  2014 check_mrtg
-rwxr-xr-x 1 root   root   145354 Nov 12  2014 check_mrtgtraf
-rwxr-xr-x 1 root   root    16614 Dec 25  2014 check_mssql
-rwxr-xr-x 1 root   root    14577 May 12  2014 check_mssql_database.py
-rwxr-xr-x 1 root   root    20215 May 12  2014 check_mssql_server.py
-rwxr-xr-x 1 root   root   190904 Nov 12  2014 check_mysql
-rwxr-xr-x 1 root   root   122024 Feb 13  2015 check_mysql_health
-rwxr-xr-x 1 root   root   175374 Nov 12  2014 check_mysql_query
-rwxr-xr-x 1 root   root   157438 Nov 12  2014 check_nagios
-rwxr-xr-x 1 root   root     6574 May 12  2014 check_nagios_performance.php
-rwxr-xr-x 1 root   root    17443 May 12  2014 check_nagiosxiserver.php
-rwxr-xr-x 1 root   root     4283 May 12  2014 check_ncpa.py
-rwxr-xr-x 1 root   root    10037 May 12  2014 check_nna.py
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_nntp -> check_tcp
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_nntps -> check_tcp
-rwxrwxr-x 1 nagios nagios  76793 May 12  2014 check_nrpe
-rwxr-xr-x 1 root   root   179842 Nov 12  2014 check_nt
-rwxr-xr-x 1 root   root   184177 Nov 12  2014 check_ntp
-rwxr-xr-x 1 root   root   173174 Nov 12  2014 check_ntp_peer
-rwxr-xr-x 1 root   root   171427 Nov 12  2014 check_ntp_time
-rwxr-xr-x 1 root   root   212399 Nov 12  2014 check_nwstat
-rwxr-xr-x 1 root   root     8779 Nov 12  2014 check_oracle
-rwxr-xr-x 1 root   root   160173 Nov 12  2014 check_overcr
-rwxr-xr-x 1 root   root   164275 Nov 12  2014 check_pgsql
-rwxr-xr-x 1 root   root   183722 Nov 12  2014 check_ping
-rwxr-xr-x 1 nagios nagios   6183 Dec 25  2014 check_pnp_rrds.pl
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_pop -> check_tcp
-rwxr-xr-x 1 root   root   281655 Dec 25  2014 check_postgres.pl
-rwxr-xr-x 1 root   root   187001 Nov 12  2014 check_procs
-rwxr-xr-x 1 root   root    23327 May 22 11:37 check_radius_adv
-rwxr-xr-x 1 root   root      510 Mar 18  2009 check_radius_simple.pl
-rwxr-xr-x 1 root   root   157631 Nov 12  2014 check_real
-rwxr-xr-x 1 root   root     9582 Nov 12  2014 check_rpc
-rwxr-xr-x 1 root   root     9743 Dec 25  2014 check_rrdtraf
-rwxr-xr-x 1 root   root     5299 Dec 25  2014 check_rrdtraf.php
-rwxr-xr-x 1 root   root     1453 Nov 12  2014 check_sensors
-rwxr-xr-x 1 root   root     2174 Mar 26  2015 check_services
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_simap -> check_tcp
-rw-r--r-- 1 root   root     7599 Dec 25  2014 check_sip
-rwxr-xr-x 1 root   root   247890 Nov 12  2014 check_smtp
-rwxr-xr-x 1 root   root    20226 May 12  2014 check_smtp_send
-rwxr-xr-x 1 root   root    10440 May 12  2014 check_smtp_send_epn
-rwxr-xr-x 1 root   root   251297 Nov 12  2014 check_snmp
-rwxr-xr-x 1 root   root    10951 Dec 25  2014 check_snmp_boostedge.pl
-rwxr-xr-x 1 root   root    17866 Dec 25  2014 check_snmp_cpfw.pl
-rwxr-xr-x 1 root   root     8747 Dec 25  2014 check_snmp_css_main.pl
-rwxr-xr-x 1 root   root    16786 Dec 25  2014 check_snmp_css.pl
-rwxr-xr-x 1 root   root    33562 Dec 25  2014 check_snmp_env.pl
-rwxr-xr-x 1 root   root    23464 May 12  2014 check_snmp_generic.pl
-rwxr-xr-x 1 root   root    31919 Dec 25  2014 check_snmp_int.pl
-rwxr-xr-x 1 root   root    10108 Dec 25  2014 check_snmp_linkproof_nhr.pl
-rwxr-xr-x 1 root   root    22965 Dec 25  2014 check_snmp_load.pl
-rwxr-xr-x 1 root   root    23886 May 12  2014 check_snmp_load_wizard.pl
-rwxr-xr-x 1 root   root    18734 Dec 25  2014 check_snmp_mem.pl
-rwxr-xr-x 1 root   root    11898 Dec 25  2014 check_snmp_nsbox.pl
-rwxr-xr-x 1 root   root    24233 Dec 25  2014 check_snmp_process.pl
-rwxr-xr-x 1 root   root    26183 May 12  2014 check_snmp_process_wizard.pl
-rwxr-xr-x 1 root   root    24002 Dec 25  2014 check_snmp_storage.pl
-rwxr-xr-x 1 root   root    25484 May 12  2014 check_snmp_storage_wizard.pl
-rwxr-xr-x 1 root   root    14489 Dec 25  2014 check_snmp_vrrp.pl
-rwxr-xr-x 1 root   root    11967 Dec 25  2014 check_snmp_win.pl
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_spop -> check_tcp
-rwxr-xr-x 1 root   root   155459 Nov 12  2014 check_ssh
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_ssmtp -> check_tcp
-rwxr-xr-x 1 root   root   141137 Nov 12  2014 check_swap
-rwxr-xr-x 1 root   root   230821 Nov 12  2014 check_tcp
-rwxr-xr-x 1 root   root   156609 Nov 12  2014 check_time
lrwxrwxrwx 1 root   root        9 Nov 12  2014 check_udp -> check_tcp
-rwxr-xr-x 1 root   root   168597 Nov 12  2014 check_ups
-rwxr-xr-x 1 root   root   138003 Nov 12  2014 check_uptime
-rwxr-xr-x 1 root   root   136153 Nov 12  2014 check_users
-rwxr-xr-x 1 root   root     2937 Nov 12  2014 check_wave
-rwxr-xr-x 1 root   root      307 Dec 25  2014 check_webinject.sh
-rwxr-xr-x 1 root   root     7065 May 12  2014 check_win_snmp_disk.pl
-rwxr-xr-x 1 root   root     2405 May 12  2014 check_wmi_plus.conf
-rwxr-xr-x 1 root   root    46543 May 12  2014 check_wmi_plus.ini
-rwxr-xr-x 1 root   root   237155 May 12  2014 check_wmi_plus.pl
-rwxr-xr-x 1 apache apache  12068 Jan  2  2015 check_x224
-rwxr-xr-x 1 root   root   131614 Nov 12  2014 negate
-rwxr-xr-x 1 nagios nagios  32666 Dec 25  2014 process_perfdata.pl
-rwxr-xr-x 1 root   root    64650 May 12  2014 send_nsca
-rwxr-xr-x 1 root   root   125860 Nov 12  2014 urlize
-rwxr-xr-x 1 root   root     1878 Nov 12  2014 utils.pm
-rwxr-xr-x 1 root   root     2791 Nov 12  2014 utils.sh

[lmiltchev]

Is the scheduled backup working now? Can you remove the old (incomplete) backups and try scheduling a new backup?

[jkinning]

So remove all the nagiosxi.* under /store/backups/nagiosxi/ and try again? I don't see any incomplete backups anymore and no the scheduled backup isn't running to my ssh server and this directory continues to grow.

[lmiltchev]

Go to Admin->Scheduled Backups->SSH, click on both, the "Test Connection" and the "Test SCP Transfer" buttons and show us screenshots of the page after each click. Schedule a SSH backup a few minutes in the future, wait for 25-30 min., then post the "/usr/local/nagiosxi/var/components/scheduledbackups.log".

[jkinning]

All attached

[tgriep]

Edit the /usr/local/nagiosxi/html/config.inc.php file and add the following if it isn't already defined in it.

Code: Select all

$cfg['backup_timeout']=2400; 

Restart apache by running

Code: Select all

service httpd restart

Then test to see if the backups start to work.

[jkinning]

I added that line, restarted httpd, and still the same results.

[tgriep]

It looks like there a permission problem on the remote server. Can you login to that system and verify that the permissions are correct on the folder you are trying to copy the backups to?

[jkinning]

Code: Select all

ll /nagios/
total 12
drwxrwxr-x 2 nagiosl users 4096 Jun 30  2014 drnagiosl1p
drwxrwxr-x 2 nagiosl users 4096 Oct  5 12:44 nagiosl1p
drwxrwxr-x 2 nagiosl users 4096 Oct  5 23:50 nagiosl1t

Code: Select all

ll nagiosl1p/
total 4283252
-rw-r--r-- 1 nagiosl users  927645696 Jun 19 00:13 nagiosxi.1434685802.tar.gz
-rw-r--r-- 1 nagiosl users 1032716288 Jun 22 00:14 nagiosxi.1434945002.tar.gz
-rw-r--r-- 1 nagiosl users  459210752 Jun 23 00:14 nagiosxi.1435031401.tar.gz
-rw-r--r-- 1 nagiosl users  509640704 Sep 28 00:15 nagiosxi.1443412201.tar.gz
-rw-r--r-- 1 nagiosl users   84340376 Sep 30 12:32 nagiosxi.1443629401.tar.gz
-rw-r--r-- 1 nagiosl users 1368170581 Oct  1 07:54 nagiosxi.1443699001.tar.gz