Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
60
votes
18 answers

Favorite rsync tips and tricks

The more I use rsync the more I realise that it's a swiss army knife of file transfer. There are so many options. I recently found out that you can go --remove-source-files and it'll delete a file from the source when it's been copied, which makes…
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
59
votes
2 answers

Can rsync display current average speed?

When I'm transferring large quantities of data using rsync, it would be helpful if I could have the average speed up until now at a glance, rather than a bunch of different speeds for each file.
Fela Maslen
  • 1,243
  • 2
  • 12
  • 19
59
votes
1 answer

rsync - Exclude files that are over a certain size?

I am doing a backup of my desktop to a remote machine. I'm basically doing rsync -a ~ example.com:backup/ However there are loads of large files, e.g. wikipedia dumps etc. Most of the files I care a lot about a small, such as firefox cookie files,…
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
56
votes
4 answers

Why is my rsync so slow?

My Laptop and my workstation are both connected to a Gigabit Switch. Both are running Linux. But when I copy files with rsync, it performs badly. I get about 22 MB/s. Shouldn't I theoretically get about 125 MB/s? What is the limiting factor…
iblue
  • 834
  • 1
  • 6
  • 12
54
votes
4 answers

Can I make rsync output only the summary?

I use rsync to backup a directory which is very big, containing many sub-directories and files, so I don't want to see the "incremental file list". I just want to know the summary in the end. If I use the argument -q, nothing is output at all. Can I…
horsley
  • 543
  • 1
  • 4
  • 4
52
votes
3 answers

Why is it not possible to use two remotes for rsync?

Note to serverfault users: This closed question is answered here by four comments by hynekcer. It is then well accepted in other comments as a regularly answerable question. It's now being voted for re-opening. When both source and destination are…
loopbackbee
  • 1,395
  • 1
  • 10
  • 21
51
votes
3 answers

Rsync to AWS S3 bucket

For a server I am hosting a website on I want to backup the data and settings to an S3 bucket. I found out that you can't directly use rsync to backup to an S3 bucket. Is there another way to achieve the following rsync command to backup the data to…
Bart Bergmans
  • 633
  • 1
  • 6
  • 9
51
votes
4 answers

run rsync as root but keep user ownership

I would like to backup user files from one server to another with rsync. but I noticed that the user folders change to root. how can I keep the user permissions with rsync (running by root)?
edotan
  • 1,876
  • 13
  • 39
  • 57
47
votes
7 answers

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync (but this just bolts on rsync to s3). …
Jaimie Sirovich
  • 571
  • 1
  • 4
  • 5
46
votes
7 answers

Why rsync is faster than NFS?

Few days ago I noticed something rather odd (at least for me). I ran rsync copying the same data and deleting it afterwards to NFS mount, called /nfs_mount/TEST. This /nfs_mount/TEST is hosted/exported from nfs_server-eth1. The MTU on both network…
grs
  • 2,235
  • 6
  • 28
  • 36
45
votes
5 answers

Rsync command issues, owner and group permissions doesn´t change

I´m trying to set owner and group via rsync and it doesn't seem to be working. This is the command: sudo rsync -rlptDvz --owner=cmsseren --group=cmsseren /home/serena/public_html/ -e ssh root@ip:/home/cmsseren/public_html2/ The files sync correctly…
Arnoldo Bazaldua
  • 549
  • 1
  • 4
  • 5
44
votes
4 answers

How to output a list of changed files from rsync?

I am using rsync in a bash script to keep files in sync between a few servers and a NAS. One issue I have run into is trying to generate a list of the files that have changed from the during the rsync. The idea is that when I run rsync, I can output…
Jason M.
  • 565
  • 1
  • 5
  • 7
44
votes
6 answers

Rsync daemon: is it really useful?

Are there any practical benefits in using rsyncd compared to rsync over ssh? Does it really increase speed, stability, anything?
kolypto
  • 11,058
  • 12
  • 54
  • 66
43
votes
1 answer

What exactly will --delete-excluded do for rsync?

I use rsync with great pleasure for backing up my servers, although I do have a question about the --delete-excluded parameter. /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@server01:/etc…
ujjain
  • 3,983
  • 16
  • 53
  • 91
42
votes
7 answers

Using RSYNC with Amazon S3

I am interested in using Amazon S3 to backup our ~ 100gb server images (created via Acronis backup tools) Obviously, this uploading to S3 every night would be expensive, in terms of bandwidth and cost. I'm considering using rsync with S3 and came…
alex
  • 1,720
  • 15
  • 43
  • 63
1
2
3
…
99 100