FTP Backup software...any suggestions?

macnorton · 11-18-08, 11:12 AM

Here is the deal...

I have a few websites (7 to be exact) that need to be backed up on a daily basis. Currently I am doing it manually and it is a pain in the ass.

What I am looking for is simple, a program that will connect to the FTP, backup the directory structure as is (a mirror copy) and store the backup in another location (an external hard drive I have setup). This whole process needs to be automated, nightly for all 7 sites. Built in encryption is fine, I won't need it since the hard drive is encrypted.

That is really all I need. Any suggestions?

GHackmann · 11-18-08, 11:35 AM

What OSes are we talking, and do you have actual SSH access to the servers you want to back up? I want to recommend rsync, but depending on your setup that might not be feasible or simple to automate.

We're using rsnapshot in the lab to back up our group's server, which has the added bonus of keeping older snapshots around in case we need to recover an older version of some data. It took a little bit of work to set up, but since then it's worked like a charm. Since it builds on rsync, it's got the same caveats about OSes.

macnorton · 11-18-08, 11:42 AM

It is a mix of Windows and Linux hosting environments. I think it is a 50/50 split.

GHackmann · 11-18-08, 02:15 PM

Hmm. That means rsync is probably more trouble than it's worth.

My next-best recommendation would be to use wget with the --mirror switch. It's less efficient than rsync for grabbing changed files, but it has the advantage that you don't need any extra software on the machines being backed up. Backing up each machine then turns into one command (wget --mirror ftp://location.being/backed/up -O /name/of/external/drive), and automating that to run every night shouldn't be too tough.

(Edit: one other disadvantage of wget is that it's strictly a mirroring program: it overwrites the last backup each time you run it. This may or may not be a problem.)

lxl · 11-18-08, 02:30 PM

How about dropbox?

http://www.getdropbox.com

You get 2GB for free, 50GB if you're willing to pay $100 a year. Your files are automatically synchonized on different systems, including all revisions.

There are some other similar services:
syncplicity:
http://www.syncplicity.com/
sugarsync:
http://www.sugarsync.com/

If you can only use FTP, try this ftpsync:
http://www.cyberkiko.com/page/FTPSync.aspx

macnorton · 11-18-08, 04:38 PM

Quote:

Originally Posted by lxl

How about dropbox?

http://www.getdropbox.com

You get 2GB for free, 50GB if you're willing to pay $100 a year. Your files are automatically synchonized on different systems, including all revisions.

There are some other similar services:
syncplicity:
http://www.syncplicity.com/
sugarsync:
http://www.sugarsync.com/

If you can only use FTP, try this ftpsync:
http://www.cyberkiko.com/page/FTPSync.aspx

Those would be great, but I need the data secured, and dumping it to another website isn't going to to work for me. However, ironically, this solves a problem I was having in the office...so thanks.

lxl · 11-18-08, 04:58 PM

Quote:

Originally Posted by macnorton

Those would be great, but I need the data secured, and dumping it to another website isn't going to to work for me. However, ironically, this solves a problem I was having in the office...so thanks.

ftpsync can sync a ftp site with local directory

macnorton · 11-19-08, 10:44 AM

Quote:

Originally Posted by lxl

ftpsync can sync a ftp site with local directory

Then I think that solves my problem. Thanks for the info.

11-18-08, 11:12 AM	#1
macnorton DVD Talk Platinum Edition Join Date: Mar 2006 Location: Northern New Jersey...or as we say it "Sopranos Country USA" Posts: 3,377	FTP Backup software...any suggestions? Here is the deal... I have a few websites (7 to be exact) that need to be backed up on a daily basis. Currently I am doing it manually and it is a pain in the ass. What I am looking for is simple, a program that will connect to the FTP, backup the directory structure as is (a mirror copy) and store the backup in another location (an external hard drive I have setup). This whole process needs to be automated, nightly for all 7 sites. Built in encryption is fine, I won't need it since the hard drive is encrypted. That is really all I need. Any suggestions? __________________ Oh really, so you liked that I made your favorite superhero a heroin addicted jazz critic who's not radioactive? – Alan Moore Thank you, Mayor Bloomberger. I accept this honor on behalf of every—Stern rules! Baba Booey! - Dennis Duffy (30 Rock) DVD / Blu-Ray / Music / Reading Material

11-18-08, 11:42 AM	#3
macnorton DVD Talk Platinum Edition Join Date: Mar 2006 Location: Northern New Jersey...or as we say it "Sopranos Country USA" Posts: 3,377	It is a mix of Windows and Linux hosting environments. I think it is a 50/50 split. __________________ Oh really, so you liked that I made your favorite superhero a heroin addicted jazz critic who's not radioactive? – Alan Moore Thank you, Mayor Bloomberger. I accept this honor on behalf of every—Stern rules! Baba Booey! - Dennis Duffy (30 Rock) DVD / Blu-Ray / Music / Reading Material

11-18-08, 02:15 PM	#4
GHackmann Senior Member Join Date: Apr 2002 Posts: 581	Hmm. That means rsync is probably more trouble than it's worth. My next-best recommendation would be to use wget with the --mirror switch. It's less efficient than rsync for grabbing changed files, but it has the advantage that you don't need any extra software on the machines being backed up. Backing up each machine then turns into one command (wget --mirror ftp://location.being/backed/up -O /name/of/external/drive), and automating that to run every night shouldn't be too tough. (Edit: one other disadvantage of wget is that it's strictly a mirroring program: it overwrites the last backup each time you run it. This may or may not be a problem.) Last edited by GHackmann; 11-18-08 at 02:19 PM.

11-18-08, 02:30 PM	#5
lxl Senior Member Join Date: Jun 1999 Location: San Jose, CA Posts: 764	How about dropbox? http://www.getdropbox.com You get 2GB for free, 50GB if you're willing to pay $100 a year. Your files are automatically synchonized on different systems, including all revisions. There are some other similar services: syncplicity: http://www.syncplicity.com/ sugarsync: http://www.sugarsync.com/ If you can only use FTP, try this ftpsync: http://www.cyberkiko.com/page/FTPSync.aspx Last edited by lxl; 11-18-08 at 02:52 PM.

11-18-08, 11:35 AM	#2
GHackmann Senior Member Join Date: Apr 2002 Posts: 581	What OSes are we talking, and do you have actual SSH access to the servers you want to back up? I want to recommend rsync, but depending on your setup that might not be feasible or simple to automate. We're using rsnapshot in the lab to back up our group's server, which has the added bonus of keeping older snapshots around in case we need to recover an older version of some data. It took a little bit of work to set up, but since then it's worked like a charm. Since it builds on rsync, it's got the same caveats about OSes.