Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
8
votes
2 answers

rsync multiple source directories to multiple dest directories

I have multiple source dirs, say /home/me/source1 and /mnt/somedisk/source2. I want to push them both to something like /home/someoneelse/dest1 and /home/someoneelse/dest respectively. I'd like to use one rsync command to this, is this…
devin
  • 1,246
  • 3
  • 20
  • 27
8
votes
1 answer

bind interface for upload : scp works, not rsync

I need to upload file on a specific interface. This cannot be set-up via iptables, because my script output on several interfaces. this is working fine : scp -oBindAddress=192.168.100.1 ... but rsync --address=192.168.100.1 is still sending on…
user1219721
  • 487
  • 1
  • 6
  • 15
8
votes
6 answers

improving rsync backup performance

What are the best techniques to improve rsync over ssh mirroring between unix boxes, assuming that one system will always have the master copy and the other system will always have a recent copy (less than 48hrs old) Also, what would one have to do…
sal
  • 827
  • 3
  • 12
  • 18
8
votes
5 answers

Forcing rsync to non-interactive mode

I would like to use rsync within a python script. I'm calling it using the subprocess module, and authenticating using public keys stored at the authorized_key file on the remote machine. The only problem is that when I use rsync using a wrong…
Adam Matan
  • 13,194
  • 19
  • 55
  • 75
8
votes
4 answers

How can I easily confirm in Linux that two separate directories have the exact same contents?

CentOS 5.x Mq question seemed similar to this one but I wasn't sure... I have two servers (completely isolated from each other), each with a directory and sub-directories that should have the same exact contents. For example the directory layout…
Mike B
  • 11,871
  • 42
  • 107
  • 168
8
votes
8 answers

Copying huge files between two remote machines - Efficiently

I have a shell script which keeps on copying huge files (2 GB to 5 GB) between remote systems. Key based authentication is used with agent-forwarding and everything works. For ex: Say the shell script is running on machine-A and copying files from…
Varun
  • 405
  • 2
  • 4
  • 7
8
votes
2 answers

What is the default remote shell for rsync?

Just curious, what is the default remote shell used by rsync when you're not using it in daemon mode? According to the man page it can be run via rsh or ssh. However nowhere in the man page does it specify how to set which one to use. So, when…
Matthew
  • 2,737
  • 8
  • 35
  • 51
8
votes
2 answers

Linux: Syncronize two directories permissions, users and groups and leave file contents untouched

In my Linux box I have two directories: work files with wrong permissions older versions of the same files with the right permissions (permissions and users and groups) I need to syncronize the permissions only without changing the file contents.…
Massimog
  • 83
  • 1
  • 7
8
votes
1 answer

Rsync and "ssh_exchange_identification: Connection closed by remote host"

I have a script which rsync's a local directory to about 10 remote servers. It basically has a list of the servers and for loops through each of them doing the rsync. To speed up the process I have it fork for each of the rsyncs, so that all 10…
Mediocre Gopher
  • 803
  • 1
  • 13
  • 24
8
votes
4 answers

How can I reduce resource usage when copying a large file?

I need to move a large file (corrupt MySQL table ~40GB) onto a seperate server in order to repair it. (When trying to repair on my production server, it quickly killed the server). In order to do this, I want to rsync the .frm, .MYI and .MYD files…
Jon M
  • 457
  • 1
  • 6
  • 11
8
votes
2 answers

rsync or sftp?

I am trying to send huge (huge as in approx 5 gb) files between servers .. Which is better, sftp or rsync ? Could someone point me to a comparision of sftp vs rsync if any available ? Is one better than the other ? If yes why ? Please advice..
Shrinath
  • 297
  • 1
  • 3
  • 18
8
votes
2 answers

Rsync ignore time comparison

What are the flags to make sure rsync ignore modification time and use checksum only?
Ken
  • 81
  • 1
  • 1
  • 2
8
votes
3 answers

rsync and include / exclude. How hard can it be?

I'm trying to recursively copy a directory / file structure from one directory to another, keeping only html files. Should be a simple case of include / exclude shouldn't it? I just want to print out the files first. When I get that right, I'll copy…
Joe
  • 529
  • 8
  • 18
8
votes
6 answers

rsync --files-from or --include-from

I tried the command: rsync -v --include-from=/path/to/list.lst /home/user /path/to/backup list.lst contains for…
Edward
  • 181
  • 1
  • 1
  • 3
8
votes
3 answers

username and password for rsync in script

I'm creating a cron job to keep two dirs in sync. I'm using rsync. I'm running an rsync daemon. I read the manual and it says: RSYNC_PASSWORD Setting RSYNC_PASSWORD to the required password allows you to run authenticated…
d-_-b
  • 1,124
  • 3
  • 11
  • 23
1 2 3
…
99 100