Ftp backup not working as expected

[WillemDH]

Hello,

Following issues I had with my root partition filling up due to some cleaner.log file, see http://support.nagios.com/forum/viewtop ... 16&t=28077

I tried using FTP backup.

The test connection and test upload seem to work as expected:

Code: Select all

 Connection established. Username/Password OK.
Test file "ftp_test_upload.txt" uploaded successfully.

When I connect to my ftp server with a filezilla client and same credentials, all seems to work ok. When I schedule the Nagios XI FTP backup, the backup is created in /store/backups/nagiosxi , but no ftp upload is done apparently..

Why would this ftp backup fail to upload the backup?

Does the ftp scheduled backup use the same backup script as the local backup? (/usr/local/nagiosxi/scripts/backup_xi.sh)

Does the ftp backup move or copy the backup?

Grtz

Willem

[jomann]

I can clarify a few things here and see if we can't figure out what's going on.

First off, the /store/backups/nagiosxi directory must exist for scheduled backups to be ran. It also must be accessible by nagios:nagcmd and apache (who is part of the nagcmd group).

To answer your questions:

"Why would this ftp backup fail to upload the backup?"
This I don't know - if the test file uploaded successfully it may not be an issue with the actual uploading but something that happens before it uploads.

"Does the ftp scheduled backup use the same backup script as the local backup?"
Yes, it uses the backup_xi.sh script to create the backup.

"Does the ftp backup move or copy the backup?"
It uploads the backup and then removes the local copy from the system.

The way the scheduled backups works is this:
Creates a local backup in /store/backups/nagiosxi -> Uploads the file it created via FTP -> Removes the local file

[WillemDH]

Ok Jake. Thanks a lor for the clarification.

So I guess I'm stuck after the script creates the local backup in /store/backups/nagiosxi as I can see the backups. The backup is not uplaoded and also not removed. I can confirm the /store/backups/nagiosxi directory exists.

let me know if there is anything I can do to troubleshoot this. I'll send you a pm with the config of the ftp backup, as it contains some sensitive information. As you can see, the ftp test upload file was succesfully.

Grtz

[jomann]

Can you check if there is a scheduledbackups.log in your /usr/local/nagiosxi/var/components directory? That may have information if there was an actual error uploading the file. Also the Apache error log may also have some information about this.

[lmiltchev]

I'll send you a pm with the config of the ftp backup, as it contains some sensitive information. As you can see, the ftp test upload file was succesfully.

I am not sure if you already sent Jake a PM, but let's check one more thing. Is there anything in the "scheduledbackups.log" that can point us to the right direction?

Code: Select all

cat /usr/local/nagiosxi/var/components/scheduledbackups.log

[WillemDH]

Jake, Ludmill,

Yes I do seem to get some errors in the logfile:

Code: Select all

 cat /usr/local/nagiosxi/var/components/scheduledbackups.log
07-07-2014 12:23:07 ERROR: Scheduled FTP Backup Failed: Local file to transfer does not exist
07-07-2014 13:18:05 ERROR: Scheduled FTP Backup Failed: Local file to transfer does not exist

Hope this helps. I scheduled the ftp backup to run again in 5 minutes. I'll let you know how it goes.

Grtz

[WillemDH]

The scheduled ftp backup ran, but didn't manage to upload the backup with ftp. It does exists in /store/backups/nagiosxi

Code: Select all

cd /store/backups/nagiosxi
ls -la
total 1703608
drwxr-xr-x  2 nagios nagios      4096 Jul  7 19:50 .
drwxr-xr-x. 5 root   root        4096 May 29  2013 ..
-rw-r--r--  1 nagios nagios 579822040 Jul  7 12:45 nagiosxi.1404727201.tar.gz
-rw-r--r--  1 nagios nagios 580223082 Jul  7 13:56 nagiosxi.1404730504.tar.gz
-rw-r--r--  1 nagios nagios 584419288 Jul  7 19:50 nagiosxi.1404755101.tar.gz

As I said, when I open an ftp session with Filezilla client with the same credentials and username, I can write files....
scheduledbackups.log did not seem to receive any errors this time..

Code: Select all

 cat /usr/local/nagiosxi/var/components/scheduledbackups.log
07-07-2014 12:23:07 ERROR: Scheduled FTP Backup Failed: Local file to transfer does not exist
07-07-2014 13:18:05 ERROR: Scheduled FTP Backup Failed: Local file to transfer does not exist

Grtz

[jomann]

I'm using a standard PHP function to do the ftp uploading... can you show us the apache error_log? /var/log/httpd/error_log or at least the lines that may be relevant... It may be hitting a resource limit if your backups are over 500mb each since our in house tests weren't that big.

[WillemDH]

Jake,

Just checked the apache error log and couldn't find any errors this day related to backup or ftp.

Grtz

[WillemDH]

Jake,

I got some strange test results. I tested twice. The first test seems to have succeeded, which I think is good news. The file nagiosxi.1404755101.tar.gz has een put on the backup ftp location. In the scheduledbackups.log, I do find "07-07-2014 20:08:05 WARNING: Scheduled FTP Backup Error: Temporary file nagiosxi.1404755101 could not be deleted" warning. I can see the log of the ftp server (I'll pm them)

The second time I tried however, it didn't manage to ftp to my ftp server. I can see the backup is still in the /store/backups/nagiosxi directory (21:25 as you can see)

Code: Select all

ls -la
total 1703888
drwxr-xr-x  2 nagios nagios      4096 Jul  7 21:25 .
drwxr-xr-x. 5 root   root        4096 May 29  2013 ..
-rw-r--r--  1 nagios nagios 579822040 Jul  7 12:45 nagiosxi.1404727201.tar.gz
-rw-r--r--  1 nagios nagios 580223082 Jul  7 13:56 nagiosxi.1404730504.tar.gz
-rw-r--r--  1 nagios nagios 584706498 Jul  7 21:25 nagiosxi.1404760921.tar.gz

I immediately tried connecting with Filezilla, same user and password from another server, which did not cause any problems.
I'll schedule one more test in 2 minutes.

Grtz