Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
30
votes
1 answer

Why does rsync spawn multiple processes for me?

I am using the following cron statement to backup from one folder to another folder in the same machine: 19 21 * * * root rsync -ac --delete /source/folder /dest/folder When I use pstree, I see the cron forked three processes …
Ryan
  • 5,831
  • 24
  • 72
  • 91
30
votes
5 answers

Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd

I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. This mostly worked, and iTunes runs much better…
Twipped
  • 643
  • 2
  • 7
  • 10
30
votes
8 answers

How can I use rsync to duplicate a directory tree, creating hardlinks to files?

From time to time, I have to perform several large migration changes on data files on my server, and I'm looking for a good way to do this. I was thinking about using rsync to duplicate my directory structure starting at the root data folder,…
Jean-Philippe Pellet
  • 492
  • 1
  • 4
  • 11
29
votes
5 answers

Do you need -e ssh for rsync?

I always used to use the following command when copying from a server: rsync --progress -avze ssh user@host:/path/to/files ./here However, a friend of mine showed me that I can simply do: rsync --progress -avz user@host:/path/to/files ./here So…
mmirzadeh
  • 393
  • 1
  • 3
  • 5
28
votes
3 answers

Does Rsync Allow Files To Be Synced Both Ways?

I have backed up a linux web server using rsync with cygwin. I now have a perfect copy of the server on my windows laptop. If i delete or modify a file on my laptop and run rsync again with cygwin will it delete/update the same file on the server?…
Dan Hastings
  • 706
  • 1
  • 13
  • 24
28
votes
3 answers

Maximizing rsync performance and throughput - directly-connected gigabit servers

I have two Dell R515 servers running CentOS 6.5, with one of the broadcom NICs in each directly attached to the other. I use the direct link to push backups from the main server in the pair to the secondary every night using rsync over…
dyasny
  • 18,802
  • 6
  • 49
  • 64
28
votes
2 answers

rsync : transferring files in one direction only

Is it possible to use rsync to copy files in one direction only? For example, suppose we have: left/a.txt right/a.txt where the files are initially identical. If one then modifies right/a.txt, then: rsync -avv left/ right/ will copy right/a.txt…
artella
  • 1,009
  • 2
  • 10
  • 6
27
votes
7 answers

Options to efficiently synchronize 1 million files with remote servers?

At a company I work for we have such a thing called "playlists" which are small files ~100-300 bytes each. There's about a million of them. About 100,000 of them get changed every hour. These playlists need to be uploaded to 10 other remote servers…
Zilvinas
  • 383
  • 1
  • 4
  • 8
26
votes
9 answers

How do you synchronise huge sparse files (VM disk images) between machines?

Is there a command, such as rsync, which can synchronise huge, sparse, files from one linux server to another? It is very important that the destination file remains sparse. It may be longer (but not bigger) than the drive which contains it. …
fadedbee
  • 2,068
  • 5
  • 24
  • 36
25
votes
7 answers

Get rsync to generate a patch file instead of copying across files?

I'm copying lots of files that have changed from one server to another using rsync. I know I can use the -n option to do a dry run, so I can see what files have been changed. However is it possible to get rsync to print a diff of the file contents…
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
25
votes
10 answers

Can I rsync to multiple destinations using same filelist?

I'm wondering if it's possible for rsync to copy one directory to multiple remote destinations all in one go, or even in parallel. (not necessary, but would be useful.) Normally, something like the following would work just fine: $ rsync -Pav /junk…
Jessie
  • 353
  • 1
  • 3
  • 6
24
votes
10 answers

Copy large file from one Linux server to another

I'm attempting to copy a 75 gigabyte tgz (mysql lvm snapshot) from a Linux server in our LA data center to another Linux server in our NY data center over a 10MB link. I am getting about 20-30Kb/s with rsync or scp which fluctates between 200-300…
Nathan Milford
  • 792
  • 2
  • 10
  • 21
24
votes
11 answers

Sync LVM snapshots to backup server

I have a number of Xen virtual machines running on a number of Linux servers. These VMs store their disk images in Linux LVM volumes with device names along the lines of /dev/xenVG/SERVER001OS and so on. I'd like to take regular backups of those…
David Hicks
  • 2,288
  • 2
  • 15
  • 12
24
votes
12 answers

Using Rsync to backup to an external drive

I'm buying an external hard drive to back up the computers in my house (finally!!). I'm hoping to use rsync. I've seen an example that does (or seems to do) exactly what I want. Something like this: rsync -aE --delete…
stalepretzel
  • 834
  • 4
  • 15
  • 19
23
votes
5 answers

rsync is just hanging, building file list

[root@centos /]# rsync -av --exclude thumbs /storage root@xx.27.1.xx:/storage root@xx.27.1.xx's password: building file list ... I've been sitting for about an hour... it's 135GB of images and folders /storage is a mounted ext3 scsi drive. Is it…
Andrew Fashion
  • 1,655
  • 7
  • 22
  • 26
1 2 3
…
99 100