Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
11
votes
7 answers

Speeding up rsync over smb

I'm backing up a Linux box over SMB to a NAS. I mount the NAS locally and then I rsync a lot of data (100GB or so). I believe it's taking an awfully long time to do it: more than 12 hours. I would expected to be much faster once everything is copied…
Pablo Fernandez
  • 7,438
  • 25
  • 71
  • 83
11
votes
1 answer

Rsync failing with "file too large"

I am writing what should be a simple backup script to copy all of my media files to an external USB drive. There seems to be one file that it chokes on and I'm not sure why. Just trying to copy that one file I get: [satori7@tyson Scripts]$ sudo…
satori7
  • 157
  • 1
  • 3
  • 11
11
votes
2 answers

Can't get rsync to work in daemon-over-ssh mode

I'm trying to set up rsync to copy the data from a server every day. In order to make the system as restricted as possible, I'm trying to use the mode described in the man page as: "USING RSYNC-DAEMON FEATURES VIA A REMOTE-SHELL CONNECTION" So I've…
rjmunro
  • 2,301
  • 4
  • 18
  • 22
11
votes
1 answer

Why does rsync forks itself? And why one such forked process is almost kinda idle (as seen in iotop)?

This is referring to the matter stated here and I am also experiencing the same. In one of my servers, I ran an rsync, to backup a huge directory (size greater than 300 Gb) to a different disk, mounted on same machine. The directory being rsynced…
Gautam Somani
  • 296
  • 3
  • 14
11
votes
4 answers

Deploying Files To Multiple Servers

We have a central repository of files in say server-1 at /srv/www. Then we have N number of servers as well. We want server-1 to be able to deploy its files in /srv/www to all servers as quickly and efficiently as possible. Is there something like…
Justin
  • 5,328
  • 19
  • 64
  • 84
11
votes
3 answers

How to mirror filesystems with millions of hardlinks?

We have one big problem at the moment: We need to mirror a filesystem for one of our customers. Thats usual not really a problem, but here it is: On this filesystem there is one folder with millions of hardlinks (yes! MILLIONS!). rsync requires more…
Thomas Berger
  • 1,700
  • 13
  • 22
11
votes
3 answers

Has anyone achieved true differential sync with rsync in ESXi?

Berate me later on the fact that I'm using the service console to do anything in ESXi... I've got a working rsync binary (v3.0.4) that I can use in ESXi 4.1U1. I tend to use rsync over cp when copying VM's or backups from one local datastore to…
JuliusPIV
  • 135
  • 1
  • 6
11
votes
1 answer

Does rsync overwrite the new file

i use rsync -avh I just want to know that if the file on destination already exists does the rsync overwrite the new file or not
John
11
votes
5 answers

ZFS Sync over unreliable, slow WAN. ZFS replication, or rsync?

I've been tasked with making an off-site backup work over the WAN. Both storage boxes are FreeBSD based NAS boxes running ZFS. Once or twice a week, 15-60 gigs of photography data gets dumped to the office NAS. My job is to figure out how to get…
Paul McMillan
  • 1,219
  • 1
  • 8
  • 17
11
votes
2 answers

Equivalent of `nice` for filesystem IO?

When I'm running an rsync backup job which involves copying over large files, the machine running the backup (both Mac desktops and Linux servers) grinds to a halt and the load average goes through the roof. I've tried: niceing the rsync process…
David Wolever
  • 2,267
  • 3
  • 24
  • 27
10
votes
3 answers

Preserving file and folder permissions with rsync

I maintain a backup of my email accounts using this command: sudo rsync -av --delete --progress -e "ssh -p pNumber" --rsync-path="/usr/bin/rsync" /vmail/ user@my_backup_server:/home/user/backups/vmail/ Source: Most email folders are owned by user…
W.M.
  • 204
  • 1
  • 2
  • 8
10
votes
1 answer

rsync xattr oddness between mac & linux?

Hullo all - I'm using rsync to back up from my mac to a fileserver runnning linux, and I see the following error: rsync -e ssh -vaxE --delete --ignore-errors 192.168.1.3:/bkup/mac/Users/dave/ /Users/dave/Desktop/dave dave@192.168.1.3's password:…
Dave Carpeneto
  • 203
  • 2
  • 4
10
votes
2 answers

Run totally silent rsync?

I have a cronjob that runs hourly, and is totally silent unless something goes wrong. Well ... almost ... A part of the job is rsync --del -Cacqrz public/. user@host.example.com:/target/path This always prints "logged in". How can I make it stop?…
jackr
  • 209
  • 1
  • 2
  • 4
10
votes
2 answers

rsync from linux host to fat32

i like to backup my linux based NAS (small files like picutres) to an attached USB Disk with FAT32. For this i like to use rsync. I know, that this will not work correct per default. rsync will sync the files again and again. I found this question…
The Bndr
  • 294
  • 3
  • 9
10
votes
2 answers

Server migration: most efficient way

I have been tasked with migrating one of our sites between servers (two different hosts). Both environments are linux. The site streams video, so the server is currently filled with media files (images and video). My first thought was that we'd use…
Ghost Code
  • 103
  • 5
1 2 3
…
99 100