Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [file-transfer]

312 questions
15
votes
2 answers

Why is scp with compression slower than without?

I needed to transfer a 20 GB KVM vdisk file, storing the root filesystem of a CentOS 6.5 VM, from one lab server to another. The large file size and the fact that I had once compressed such a vdisk file to a few hundred mega-bytes made me…
pdp
  • 778
  • 1
  • 7
  • 16
15
votes
3 answers

Getting rsync to move file from source to destination?

Is rsync is a good choice for my project ? I have to : - copy files from source to destination folder via SSH, - be sure all files are copied, - delete source files after copy. - if I have conflict name, I have to rename files. It looks like I…
user44782
  • 265
  • 1
  • 3
  • 5
14
votes
19 answers

What is the simplest and fastest way to transfer large file through a Windows network?

I have a Window Server 2000 machine running MS SQL Server that stores over 20GB of data. The database is backed-up every day to the second harddrive. I want to transfer those backup files to another computer to build another test server and for…
Sake
  • 417
  • 3
  • 5
  • 12
13
votes
9 answers

Windows rsync that supports long file names, or an good alternative?

I currently rsync on a Linux host to copy things from Windows to my Linux box. But I can't copy files with long names. I have tried DeltaCopy, cwrsync, and cygwin. From what I have found there all of these tools refuse to copy files when the…
Zoredache
  • 130,897
  • 41
  • 276
  • 420
13
votes
3 answers

Easy way to transfer files between host and LXC container on LVM

This is an easy task in the case of containers that share the same filesystem but I'm not sure what would be the proper approach for containers that use LVM disks. I know I could use rsync or scp but I would like to know if it is possible to do this…
s3v3n
  • 336
  • 2
  • 4
  • 13
13
votes
6 answers

How do you limit the bandwidth for a file copy?

I've got an old windows 2000 box in a remote location with a T1 connection and a vpn to my location. I normally use smb mounts to transfer files but now it's time to decommission the server and copy it's backups to my location. I have about 40…
reconbot
  • 2,455
  • 3
  • 25
  • 30
12
votes
1 answer

Getting rsync to delete files from the *sender* after transfer

I'm using rsync to move one directory to another. Is there some way to get rsync to incrementally delete a file from the sender after it has copied it to the reciever?
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
10
votes
7 answers

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would max out a 100mbit connection over the internet and…
incognito2
  • 935
  • 4
  • 13
  • 17
9
votes
4 answers

Use scp to copy a file to different servers

I have to copy a file to different servers almost every day. What I usually do is: scp filename user@destinationhost:/destination/folder I run this same command changing the destination host over and over again until I finish all the servers. What…
Ruben
  • 93
  • 1
  • 1
  • 4
9
votes
4 answers

Linux to Linux, 10 TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100 GB is different from 10 TB). I've got about 10 TB that I need to move from one RAID array to another, gigabit…
lostincode
  • 193
  • 1
  • 4
9
votes
4 answers

Transfer files via SSH

I want to use file transfer via SSH on some scripts. I've read it's possible to tar over ssh. Where should I start reading?
Fernando Briano
  • 470
  • 1
  • 8
  • 14
8
votes
2 answers

Storage Space Write cache, and write speed

I have been working on my NAS that is using server 2012r2 with storage spaces. the drives are off the shelf 7200 rpm drives the drives are bitlocker encrypted the drives are in a 8 disk parity layout My question is this. Using SMB multichannel I…
Hunter Brelsford
  • 119
  • 1
  • 2
8
votes
2 answers

Debug slow lan (ssh, nfs) file transfer

I've got two linux boxes attached to a gigabit switch. They both have gigabit NICs, cables are cat7. Testing the network with iperf shows a fast connection but transferring files with rsync, scp, or nfs share is slow. I'm testing with one 1GB…
pinpox
  • 83
  • 4
8
votes
5 answers

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster without it? What factors does this depend on? (I…
Corey Goldberg
  • 183
  • 1
  • 1
  • 5
7
votes
3 answers

Copying terabytes of hundreds of thousands of files in folder slow

I am currently running FreeNAS and using SMB 3 on windows machines to copy folders with 80000+ files that are all about 35MB each. Here is the config FreeNAS 2x40Gbps connections bonded connection SMB Share with SMB 3.1 enabled 1 Xeon 8 core with…
cohortq
  • 475
  • 1
  • 6
  • 13
1
2
3
…
20 21