Questions tagged [file-transfer]

312 questions
4
votes
1 answer

Out of Disk Space, /mnt/hgfs to blame?

I'm running a Centos VM in VMWare Fusion 5.x. The VM is running a file transfer server and the files being sent are stored on a disk shared from the host, /mnt/hgfs/Aspera. It looks like the file transfers are taking up space on the root volume. I…
4
votes
4 answers

10Gbps iSCSI network transferring at only 2Gbps

I have a performance issue with my SAN. I have a full 10Gbps private network setup. I have the following setup 1 - Mac with Connected with via Fiber Transciever 10GbE 1 - Windows 7 PC with 10GbE 1 - HP Switch with All ports are 10GbE 2 - Quantum…
cohortq
  • 475
  • 1
  • 6
  • 13
4
votes
2 answers

Speed up rsync by running multiple instances at once?

I have to transfer a big directory to another server. My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast. Basically the functionality that any download manager nowadays…
The Shurrican
  • 2,240
  • 7
  • 39
  • 60
4
votes
6 answers

How can we share large files with people outside of our firewall?

We sometimes need to share/recieve large files (sometimes in the gigabytes) to outside contractors or customers. These files are mostly CAD drawings, but could include almost anything. We want to only allow the the outside customer/contractor to…
Mike Wills
  • 834
  • 6
  • 19
4
votes
7 answers

Apache HTTP server - How to determine on the server if a download finished and of which file?

We have an Apache HTTP server up and running, which serves dynamically created zip archives to the users which are possibly several 100s of megabytes in size. As we create a new file with every click on the "download" button (even if the content did…
Wolfram
  • 143
  • 1
  • 5
4
votes
6 answers

Looking for a faster way to transfer file to a windows network share

Update: This is just for one way transfer. No need to sync. I am currently using Robocopy to transfer a huge file which is zipped and send to a remote network share. Is there a faster tool? Lately, file sizes have been increasing and the transfer…
Gulzar
  • 381
  • 2
  • 7
  • 13
4
votes
4 answers

Robocopy really slow across LAN

DISCLAIMER: I'm a programmer, not an admin! I am setting up web apps in a new server cluster and copying files using xcopy or robocopy and UNC paths between servers on the same subnet is really slow. SOmetimes it seems to sporadically speed up,…
Brian Donahue
  • 141
  • 1
  • 1
  • 3
4
votes
3 answers

Are there good ways to transfer very large files (2TB) over the Atlantic?

My company regularly needs to send about 2TB of data from the US to the UK (the size of the compressed delta is 2TB). Even though each side has good internet connectivity, sending files directly is too slow and unreliable. At 1MB/s, the transfer…
static_rtti
  • 151
  • 3
  • 6
3
votes
2 answers

Cannot transfer large file(s) using remote desktop connection (Windows 2012 server)

I am trying to transfer over a large file using remote desktop. I end up getting this error from the image below. Source computer is a windows 7 laptop and destination is a windows 2012R2 server. Note: I was able to send small files over but when…
3
votes
1 answer

Exclude a set of file types when running rsync

I'm running the following rsync command rsync --times -v --recursive --compress --exclude "*.svn" --rsh=/usr/bin/ssh source/folder/ user@ip:httpdocs/ which excludes *.svn files when running. My question is how do I pass it a list of file types to…
neilc
3
votes
3 answers

Ignore windows hidden files when copying with rsync

I need to keep in sync a very large directory structure (a few hundreds GB) between a Windows machine and a Linux machine. I'm using rsync to do the copy because it automatically ignores unchanged files and is more effective at copying changed files…
Guss
  • 2,670
  • 5
  • 34
  • 59
3
votes
2 answers

Secure FTP/SCP "breaks" existing files while they are being transfered

Typically I upload updated files/scripts over Secure FTP to my server to replace existing copies of those files as I make changes. But this has the nasty behavior of writing directly to those files. This means that while the files are being…
DivideByHero
  • 371
  • 1
  • 3
  • 8
3
votes
6 answers

Replacement for FTP?

I have some fairly large file transfers going across the atlantic every morning by ftp. From time to time the transfers will be distrupted, likely due connectivity issues, and the files will be left in an incomplete state. I'm wondering if there is…
Roy
  • 4,376
  • 4
  • 36
  • 53
3
votes
5 answers

What is the most efficient way to push out/publish large sets files over a network?

Here's my scenario: We have a need to push out a set of files (a 'workspace') from a source server to multiple destination servers. The files are kept under version control (SVN) so the first step is to export the latest version of the repository to…
AR.
  • 165
  • 1
  • 2
  • 6
3
votes
4 answers

SMB File Transfer Manager application for Windows?

I'm in the process of transferring very large files over an unreliable network connection using normal SMB (windows share folder). Of course, using Windows Explorer means that any time that connection is interrupted, all progress were lost, and any…
Justin Searls
  • 224
  • 1
  • 3
  • 7