-1

We're moving 10 Tb of data from local storage to S3. I'm mostly automating the task using s3express.

However: the data technicians would like a tool similar to the VisaVersa 'compare' function; The open up a GUI pane. Select files files in 'source' and 'delete if exist on target' and away they go.

They're not comfortable with CLI tools - is there a Windows-based GUI tool that can do this?

Brian Dunbar
  • 183
  • 1
  • 14
  • `robocopy` perhaps...? – Nathan C Aug 25 '14 at 15:31
  • @NathanC Robocopy supports S3? – EEAA Aug 25 '14 at 15:33
  • @EEAA Granted, it needs to be mounted as a drive with something like [TnTDrive](http://tntdrive.com/) or similar, but it would work. – Nathan C Aug 25 '14 at 15:40
  • 1
    I should mention, for the volume of data you're having to deal with, you really ought to consider using the AWS Import/Export service. With this, you send your data to them on one or more hard disks and they handle importing into an S3 bucket of your choosing. This will almost certainly be much faster unless you have an absurdly fast internet circuit. – EEAA Aug 25 '14 at 15:51
  • re: Import/Export. I may revisit that. Testing indicated we could get it done in three weeks. I did not take into account a) the software was buggy and b) our process was not fully worked-out for communicating what directories are being moved and when. The biggest roadblock is that this particular service is all hosted and getting them to 'put the data on a drive' is not easy and not cheap. Which is one reason we're moving to S3 ... – Brian Dunbar Aug 25 '14 at 21:20

1 Answers1

2

Yes, CloudBerry Explorer support this functionality. Its their 'Move' option.

Moves the file from source to destination, deletes in the source.

If the file is already there, you can do the same thing, but overwrite/ignore, and delete.

Link to Download

Edit: As a sidenote, if your AWS S3 consultants aren't comfortable with command line interfaces to the AWS platform, I would question their actual knowledge of the platform.

Travis Stoll
  • 341
  • 2
  • 12
  • Fair point. However, these are not consultants but our in-house 'data technicians'. Which is a grand title for a job that used to be called 'clerk' but what can you do. – Brian Dunbar Aug 25 '14 at 15:52
  • 2
    In my experience, "Data technicians" primary job responsibilities revolve around following work instructions. In this case, just write up an easy-to-understand guide using your cli tool and be done with it. – EEAA Aug 25 '14 at 15:57
  • Agreed, and fair point. I misinterpreted the end user. – Travis Stoll Aug 25 '14 at 16:31