0

How disable multipart upload so sync matches the md5sum of local and remote file in s3cmd. When I upload a large file, s3cmd separates the file into parts. The eTag on Amazon S3 is the last part of the multipart. How can I preserve the file uploaded with the md5sum of the local file.

John Rotenstein
  • 241,921
  • 22
  • 380
  • 470
Marvado
  • 331
  • 1
  • 3
  • 11

1 Answers1

1

You can manually calculate and send (save) md5sum of the whole object in the custom HTTP header. You can add any HTTP header when you send PUT request, and you will get the same header and value for the next GET or HEAD requests. We use this feature in our project RioFS, to save md5sum of the stored object and then compare the hash with the cached object to avoid re-downloading local files.

Hope this information helps you !

Paul
  • 1,262
  • 8
  • 16
  • so you don't use the sync at all in s3cmd? Just calculate the md5sum and put the file passing the x- metatags in Amazon S3? – Marvado Oct 23 '13 at 15:57
  • 1
    yes, we don't use s3cmd. You are right, you can PUT any value to x-meta tags and you will get that when you next time access this object. – Paul Oct 23 '13 at 16:30