0

I have the following currently created in AWS us-east-1 region and per the request of our AWS architect I need to move it all to the us-east-2, completely, and continue developing in us-east-2 only. What are the easiest and least work and coding options (as this is a one-time deal) to move?

  1. S3 bucket with a ton of folders and files.
  2. Lambda function.
  3. AWS Glue database with a ton of crawlers.
  4. AWS Athena with a ton of tables.

Thank you so much for taking a look at my little challenge :)

bda
  • 372
  • 1
  • 7
  • 22
  • *"per the request of our AWS architect"* ... did they give a reason? – Michael - sqlbot May 07 '20 at 12:22
  • Need to start using AWS Athena in us-east-2, since it has a smaller IP range, which is easier to whitelist (a lot less IPs to enter) for a port rule. Our security team will not whitelist ports for an FQDN address, hence the need to use the IP range. I am not an expert on security or firewalls, but this is the story I was told. – bda May 07 '20 at 14:04

2 Answers2

1

There is no easy answer for your situation. There are no simple ways to migrate resources between regions.

Amazon S3 bucket

You can certainly create another bucket and then copy the content across, either using the AWS Command-Line Interface (CLI) aws s3 sync command or, for huge number of files, use S3DistCp running under Amazon EMR.

If there are previous Versions of objects in the bucket, it's not easy to replicate them. Hopefully you have Versioning turned off.

Also, it isn't easy to get the same bucket name in the other region. Hopefully you will be allowed to use a different bucket name. Otherwise, you'd need to move the data elsewhere, delete the bucket, wait a day, create the same-named bucket in another region, then copy the data across.

AWS Lambda function

If it's just a small number of functions, you could simply recreate them in the other region. If the code is stored in an Amazon S3 bucket, you'll need to move the code to a bucket in the new region.

AWS Glue

Not sure about this one. If you're moving the data files, you'll need to recreate the database anyway. You'll probably need to create new jobs in the new region (but I'm not that familiar with Glue).

Amazon Athena

If your data is moving, you'll need to recreate the tables anyway. You can use the Athena interface to show the DDL commands required to recreate a table. Then, run those commands in the new region, pointing to the new S3 bucket.

AWS Support

If this is an important system for your company, it would be prudent to subscribe to AWS Support. They can provide advice and guidance for these types of situations, and might even have some tools that can assist with a migration. The cost of support would be minor compared to the savings in your time and effort.

John Rotenstein
  • 241,921
  • 22
  • 380
  • 470
0

Is it possible for you to create CloudFormation stacks (from existing resources) using the console, then copying the contents of those stacks and run them in the other region (replacing values where they need to be).

See this link: https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/resource-import-new-stack.html

Chris Williams
  • 32,215
  • 4
  • 30
  • 68