Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
7
votes
7 answers

Windows based rsync server

Is there a way to build a Windows server what can be target for other Windows file servers with rsync ?
Glendyr
  • 621
  • 2
  • 7
  • 12
7
votes
3 answers

How can I prevent vanishing error when using rsync with an nfs mount?

I'm in the process of moving files from an Ubuntu server to a Snow Leopard server. The Ubuntu server has an NFS share of around 6TB which I'd like to clone to the Snow Leopard server. I mounted the nfs share on the Snow Leopard server and then…
Evan
  • 227
  • 1
  • 3
  • 8
7
votes
3 answers

rsync with --hard-links freezes

I have a large directory called servers, which contains many hard-links made by rsnapshot. That means that the structure is more or less…
Adam Matan
  • 13,194
  • 19
  • 55
  • 75
7
votes
2 answers

Malformed rsync command on ReadyNAS

I'm trying to set up rsync backups on my ReadyNAS and I'm getting the following error: ERROR: The remote path must start with a module name not a / This error is accompanied by the following information: Job: 015 Protocol: rsync Source:…
Jason Swett
  • 1,468
  • 5
  • 23
  • 37
7
votes
7 answers

rsyncing a bootable backup

jwz mentions PSA: Backups a backup system that's fairly clever. Your backup method is to essentially restore to the replacement drive. This seems to work simply on OSX. What all do I need to do to adopt this guide to Ubuntu?
jldugger
  • 14,342
  • 20
  • 77
  • 129
7
votes
3 answers

Chunking large rsync transfers?

We use rsync to update a mirror of our primary file server to an off-site colocated backup server. One of the issues we currently have is that our file server has > 1TB of mostly smaller files (in the 10-100kb range), and when we're transferring…
Gabe Martin-Dempesy
  • 410
  • 6
  • 11
7
votes
9 answers

Copy 10 million images in a single folder to another server

Now I know you shouldn't ever put 10 million files into a single directory to begin with. Blame it on the developers, but as it stands that’s where I am at. We will be fixing it and moving them into folder groups, but first we gotta get them copied…
The Digital Ninja
  • 764
  • 4
  • 10
  • 25
6
votes
1 answer

Does AWS cli do a data integrity check on sync with s3?

I've been looking into using AWS cli for data integrity checks to verify a backup has been transferred from a Linux file server correctly to AWS s3. Likewise, I would like to verify when restoring a file from backup to the Linux file server it also…
Edward_178118
  • 955
  • 4
  • 15
  • 33
6
votes
7 answers

Backup - rsync or tar

We're looking to backup about 100gb+ of data containing small files (10kb+) each. The backup needs to be done as fast as possible to another harddrive weekly. Which is the better (especially speed wise) way to backup in such scenario? Rsync, or tar?
Paatrick
6
votes
2 answers

Restricting a ssh key to only allow rsync/file transfer?

I have 2 servers (A & B), and I need to rsync files from A to B as root. Allowing root ssh login is possible (PermitRootLogin without-password), but I'd like to lock it down as much as possible. I'm using ssh keys, and (on B) the root ssh key (in…
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
6
votes
1 answer

"protocol version mismatch — is your shell clean?" rsync error when the shell IS clean

I'm trying to download files using rsync with rsync running in daemon mode over SSH on the server and get the following error on the client: rsync -a myserver:/remote/path/ localdestdir/ protocol version mismatch -- is your shell clean? (see the…
EM0
  • 370
  • 9
  • 24
6
votes
3 answers

force rsync timeout on stalled connection

I have a problem with a defective round robin data mover node I'm rsync'ing data from. One of the nodes keeps dropping the data connection to the file system my data is coming from and needs to reconnect, which can take up to several minutes. During…
John
  • 103
  • 1
  • 5
6
votes
10 answers

Using rsync to quickly upload a file that is similar to another file

I'm putting together a deployment script which tars up a directory of my code, names the tar file after the current date and time, pushes that up to the server, untars it in a directory of the same name and then swaps a "current" symlink to point at…
Simon Willison
  • 655
  • 1
  • 7
  • 8
6
votes
0 answers

BackupPC using rsync fails with "protocol version mismatch -- is your shell clean?"

I just installed BackupPC in a Debian box to use it as backup server. As you know, this software makes use, among others, of rsync. When using the rsync option, it fails. Server: Debian Jessie. BackupPC 3.3.1 built from source, executed by user…
zisk0
  • 63
  • 7
6
votes
6 answers

Preserve ownership with rsync, without root

I would like to perform incremental backups (for the entire filesystem) from a machine. rsync does this quite will, however I would like to also preserve file ownership - meaning, make it possible to restore it. Is this possible to do without…
Vladimir Panteleev
  • 1,737
  • 5
  • 20
  • 34
1 2 3
…
99 100