Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
10
votes
7 answers

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would max out a 100mbit connection over the internet and…
incognito2
  • 935
  • 4
  • 13
  • 17
10
votes
3 answers

is it safe to running multiple instances of rsync together

I'm wondering if its safe to use multiple rsync instances with the same command line to backup the same directory on the local server to the same directory on the remote server? basically if I ran the command below 3-4 times in parallel would it…
incognito2
  • 935
  • 4
  • 13
  • 17
10
votes
2 answers

rsync copy new files only, no updates?

I would like to use rsync to copy files from a remote server. I would like to only copy files from server, not push any back out. copy files that don't exist. If the remote file is newer I do not want to copy it have it automatic. This prompts me…
user274
10
votes
1 answer

Using a shell script to check if rsync made any changes

I've got a bash script that rsync's two directories. Sometimes there's a change, odds are there's nothing. I want to run a command only if rsync actually made a change (add/update a file). Otherwise I want to just skip it. Is there a return…
raccettura
  • 141
  • 2
  • 7
9
votes
12 answers

rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6]

Recently I have been unable to rsync over ssh. Each time I get the same error bash: rsync: command not found rsync: connection unexpectedly closed (0 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at…
TucDev990
  • 113
  • 1
  • 1
  • 3
9
votes
4 answers

rsync error: remote command not found (code 127) at io.c(605):

I get the following error: sudo ionice -c 3 nice -n +19 rsync -av --progress -e 'ionice -c 3 nice -n +19 ssh -l root -p 22 192.168.0.1' 192.168.0.1:/domains/remote/. /domains/local/; root@192.168.0.1's password: bash: 192.168.0.1: command not…
klor
  • 344
  • 4
  • 8
  • 25
9
votes
4 answers

How to make sshfs + VPN + git a tolerable working environment?

Currently the code base for the project I am working on is remotely on a company server. and it has to stay like that. also the remote git repository cannot be made public. My current setup is: Connect to the VPN run sshfs to mount a copy of the…
Asgaroth
  • 199
  • 1
  • 5
9
votes
1 answer

Does rsync delete local files if they were deleted on source folder?

Here's what I'm trying to do: In essence, get files from one net storage device synced to another net storage device. The solution was to rsync from the source net storage to a local machine. Then rsync from local machine to destination net…
joedevon
  • 236
  • 3
  • 8
9
votes
3 answers

rsync: How to exclude Dotfiles only in topmost directory?

When performing backups under Bash with rsync, I'm trying to exclude all dotfiles and hidden directories in the top directory, but not those in otherwise targeted directories. For example: /copyme.c /.dontcopythisfile …
user937189
9
votes
2 answers

rsync "Operation not permitted"

I am trying to so a simple rsync to a USB hard disc, the command is rsync -az --modify-window=2 /home /mnt/exthd/tmp/ I am running this as root. but I get a lot of errors that all seem to relate to insufficient permissions : rsync: chown…
Tim the Enchanter
  • 347
  • 2
  • 6
  • 21
9
votes
4 answers

Multi Threaded file sync between 2 Linux servers

At the moment i'm running rsync for 2.2 million files total of 250GB and that just takes ages 700K files in 6 hours. Does anyone know a rsync like tool that can do this with multiple threads so it goes faster?
Tom van Ommen
  • 93
  • 1
  • 1
  • 3
9
votes
3 answers

rsync via cron. How do I enable logging?

I'm backing up a remote server to another computer using rsync. In cron.daily I have a file with this: rsync -avz -e ssh root@example.com:/ /mybackup/ It uses a public / private key pair to login. This seems to work well most of the time however,…
tetranz
  • 315
  • 2
  • 6
  • 14
9
votes
4 answers

Linux to Linux, 10 TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100 GB is different from 10 TB). I've got about 10 TB that I need to move from one RAID array to another, gigabit…
lostincode
  • 193
  • 1
  • 4
8
votes
4 answers

Rsync size is difference from source to destination

I'm using rsync with the options -r for recursive -l copy symlinks as symlinks -t preserve modification time -D preserve devices and specials -v verbose --prune-empty-dirs The source FS is ext4 and the destination is XFS. I've copied few hundred…
lbanz
  • 1,609
  • 5
  • 20
  • 30
8
votes
5 answers

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster without it? What factors does this depend on? (I…
Corey Goldberg
  • 183
  • 1
  • 1
  • 5
1 2 3
…
99 100