Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
13
votes
4 answers

Why don't people just use rsync to back up vmware guests?

If I am running a modern vmware ESXi system, I can drop in a statically linked rsync binary and rsync files to any destination over SSH. I'm trying to understand why most (all ?) backup of vmware guests is not done this way. If the VM is running,…
user227963
  • 209
  • 1
  • 2
  • 11
13
votes
5 answers

How to fix corrupt packet error for with rsync for (relatively) large files?

Trying to update files on a server, with the rsync command: rsync -ravq -e "ssh -o ConnectTimeout=2 -o ServerAliveInterval=2 -ServerAliveCountMax=2" --delete ./local_dir user@$SERVER:/dest_dir corrupt packet errors keep getting thrown,…
Juan Carlos Coto
  • 677
  • 2
  • 6
  • 13
13
votes
4 answers

How to cleanup after failed rsync?

I killed a local "rsync -ah" process. It left junk files like ".abc.vmdk.zxivMN" in the target directory. The junk files do not get deleted on consecutive "rsync -ah" runs. Details: I ran diff on both folders I was syncing and it reported: "Only in…
user27465
  • 259
  • 2
  • 7
13
votes
4 answers

rsync to compressed archive of file

I take backups of a server with rsync, but those backups are quite large, and I'd like to compress them. Is there a way to have some sort of wrapper around rsync to gunzip the file in the backup, rsync the changes from the live file, then re-gzip…
rjmunro
  • 2,301
  • 4
  • 18
  • 22
13
votes
8 answers

make a cronjob wait for previous rsync job to finish

I'm using rsync to backup some data from one server to another. All works fine, but it might take longer to finish depending on how much data there is to transfer. Is there any gauranteed way to ensure that an rsync command doesn't start before the…
chovy
  • 340
  • 1
  • 5
  • 16
13
votes
1 answer

rsync requires rsync-path when remote rsync is in path

I am quite confused as to why rsync requires --rsync-path flag even when remote rsync is in path. Consider: $ rsync -avze 'ssh -p 22' --delete public/ pmatos@domain.com:~/public_html bash: /usr/local/bin/rsync: No such file or directory rsync:…
Paulo Matos
  • 299
  • 2
  • 3
  • 10
13
votes
3 answers

How to add timestamp and file list to rsync log?

I want to add both timestamp and file list to the log. Currently, I can only get one. The following command to can track the updated file list but it does not add timestamp. rsync -avz --progress --delete /web/path/public_html/…
garconcn
  • 2,388
  • 8
  • 35
  • 46
13
votes
4 answers

Escaping spaces in a remote path when using rsync over a remote SSH connection

When using SSH to connect rsync to a remote server, how do you escape spaces and such in the remote path? A simple backslash escapes the space for the local bash prompt, but on the remote machine the space is then being read as a break in the path,…
purefusion
  • 275
  • 1
  • 3
  • 9
13
votes
4 answers

Tell Rsync to Skip Current file During Transfer?

Is there a way to tell rsync to skip its current file while a sync is in progress, maybe by sending it a particular signal? I already know about ignoring based on patterns, but this would be handy to me sometimes.
Kyle Brandt
  • 83,619
  • 74
  • 305
  • 448
12
votes
3 answers

rsync --iconv option on Mac not working (sync from remote Linux server to local Mac)

I want to use rsync to backup data from a remote Linux server to my local Mac. And I want to initialise this operation on my local Mac. All works fine except that there is a special character problem: every time I re-run the rsync operation (after…
Nick The Swede
  • 421
  • 1
  • 3
  • 14
12
votes
1 answer

Getting rsync to delete files from the *sender* after transfer

I'm using rsync to move one directory to another. Is there some way to get rsync to incrementally delete a file from the sender after it has copied it to the reciever?
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
12
votes
2 answers

rsync - failed to set permission - operation not permitted

I got the following command with this error rsync -avz --links -O /home/jansiatest/.jenkins/workspace/svn_to_demo/trunk/CPS/ jansia@ps27670.dreamhost.com:/home/tasklite/temp sending incremental file list ./ rsync: failed to set permissions on…
Jerome Ansia
  • 261
  • 1
  • 2
  • 10
12
votes
2 answers

Inode tables shrinking sharply over time causing rsync/inode problems

We setup a Linux (it's on Amazon AWS, a CentOS-like system although we are not exactly sure the customizations done on it) system with 4TB storage as an XFS volume over LVM (ultimately to be used for serving over NFS4, but it is not in use yet), and…
Bernard Chan
  • 121
  • 3
12
votes
3 answers

Set maximum speed for scp

Is there a way to limit the speed of scp (or rsync)? I couldn't find any information in the man page, nor on the internet.
user28362
  • 556
  • 3
  • 7
  • 21
11
votes
4 answers

rsync directory so all changes appear atomically

I do some nightly and weekly mirrors of frequently used repositories for the local network. On a few occasions, someone has tried to do an update while the rsync is happening and failed because the expected files aren't all there yet. Is it…
mikebabcock
  • 420
  • 4
  • 12
1 2 3
…
99 100