Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1595 questions
6
votes
1 answer

Slow synchronisation stage on gsutil rsync?

I've just started to use GCS as backup for my web servers. One server has 1.2 million JPEGS (3.5TB) and this all rsynced over flawlessly over 10 hours or so. The other has 2.5 million JPEGS (just thumbnails/previews though - 300GB total). The…
Codemonkey
  • 1,086
  • 4
  • 19
  • 41
6
votes
1 answer

Rsync - Setting up rsync user and their permissions

I will be setting rsync between two webserver. I am aiming to have backup of data from my primary server on the secoundary in case if primary server crashes. My question relates to setting up on primary server a user account for rsync purposes.…
Abdel5
  • 171
  • 1
  • 1
  • 6
6
votes
4 answers

rsync: mkdir "2014-11/." failed: No such file or directory (2)

i'm write a script for automation copying file with rsync from server-a to server-b this is my script : #!/bin/bash NOW=$(date +"%Y-%m") rsync -au --ignore-existing /var/www/uploads/$NOW/* -e root@1.1.2.2:/var/www/uploads/$NOW/. when we are going…
syntaxerro
  • 61
  • 1
  • 2
  • 6
6
votes
2 answers

Rsync + public key authentication security

I have read several articles how to automatically backup files with Rsync and public key authentication. All of them are very similar. I just finished setting up everything and everything works fine but... I just found an article which says it's not…
tfegc
  • 221
  • 1
  • 5
  • 10
6
votes
2 answers

rsync not deleting Folders in destination

I know there are some questings with the same topic here but no answers helped me. First, this is my script. It should copy all files from the source to the destination (preserving all rights, etc). If a file or directory is deleted in the source it…
virtualmarc
  • 183
  • 1
  • 1
  • 7
6
votes
1 answer

rsync from remote ssh server with forwarded keys

Context I am writing a synchronisation script to sync some web environments. Ex: Update integration from production (mostly to fetch new database rows and uploaded files) Some of my prerequisites are : Developpers will use this script from the…
Huge
  • 231
  • 3
  • 6
6
votes
1 answer

Can't get rsync over sftp to work

I'm trying to set up a backup system from an Ubuntu server to a Synology NAS (DS413j) using rsync and sftp. I have created a user for this that we can call ubuntu-backup. I have a directory in ubuntu-backup home directory called www where the backup…
Patrik
  • 163
  • 1
  • 6
6
votes
7 answers

rsync take too long to run

I have a load balancer setup involve 2 server. these 2 server mirror each other. the main usage of the blanacer is serving static files. Let's call them Server A and Server B. Server A will retrieve file from remote host on different network. those…
myhusky
6
votes
6 answers

rsync/ssh/rsnapshot backup -- remote script execution

I have the following settings in my configuration file: (/etc/rsnapshot.conf) Script/Tool: http://www.rsnapshot.org/ backup_script ssh root@host.domain.com "sh /home/user/backup_mysql.sh" ./mysql the example shows the…
Tiffany Walker
  • 6,681
  • 14
  • 56
  • 82
6
votes
1 answer

Is there a global config file for Unison synchronization tool?

I'd like all my unison profiles to have merge = Name * -> meld CURRENT1 CURRENT2 diff = /usr/bin/meld CURRENT1 CURRENT2 confirmmerge = true as options. I know I can add these options to each .prf files in ~/.unison/, but having a global config file…
mp04
  • 187
  • 8
6
votes
2 answers

rsync for backup considered dangerous?

In our research group, we have the need to backup data acquired on the MRI scanner in a way that will preserve any scan ever acquired (even though data might be deleted from the scanner due to space or other reasons). We call this our vault. To…
DrSAR
  • 221
  • 1
  • 2
  • 8
6
votes
5 answers

Gzip Piped to Rsync

I want to do something like gzip a file, then immediately rsync it to another server so that the created gzip file will not be written on the local server. I was thinking of doing something like this... but obviously this fails. gzip file | rsync…
bichonfrise74
  • 95
  • 2
  • 4
  • 8
6
votes
6 answers

Rsync Remote to Remote

I'm looking for a solution for using rsync between 2 remote servers. It seems like its not possible. Does any one know why its not possible? I ask that because I think if I know the reason, maybe I could use another tool to make it possible. Update:…
AliBZ
  • 253
  • 1
  • 2
  • 10
6
votes
2 answers

What's faster for copying files from one drive to another?

Running linux. I have two identical drives mounted on the same machine. What is faster CP, MV, or RSYNC? Why is one faster than the other? Are there any faster alternatives?
T. Brian Jones
  • 927
  • 4
  • 17
  • 29
6
votes
2 answers

rsync to adapt links that have absolute paths to the location at destination

Would it be possible with rsync to adapt the absolute, symbolic links to a new location at the destination? Test case Imagine I have a link pointing to a file like this: /usera/files/common/test_file /usera/files/common/links/test_link ->…
ronszon
  • 163
  • 3
1 2 3
…
99 100