Questions tagged [aws-dms]

AWS Database Migration Service (AWS DMS) can migrate your data to and from most widely used commercial and open-source databases such as Oracle, PostgreSQL, Microsoft SQL Server, Amazon Redshift, Amazon Aurora, MariaDB, and MySQL. The service supports homogeneous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to MySQL. The source or target database must be on an AWS service.

http://docs.aws.amazon.com/dms/latest/userguide/Welcome.html

465 questions
0
votes
0 answers

How to enable transaction timestamp in MySQL binary log to include microseconds part of the time

I needed some help from the community on an issue I am stuck with. We use AWS DMS to read from the MySQL binary logs to captures changes. Our Production system is active, meaning multiple transactions can happen over a second. But it seems MySQL…
0
votes
1 answer

migrate mongodb table by specefic columns only to mysql using aws dms

I have a schema named reports in mongo and a collection named totals. The keys in it looks like: { "_id" : { "dt" : "2018-12-02", "dt2" : "2018-04-08", "num" : 1312312312 }, "str" : 1 } I would like to use DMS to migrate this collection into…
Nir
  • 2,497
  • 9
  • 42
  • 71
0
votes
1 answer

Why does AWS DMS occasionally encounter various kinds of errors?

The important things about this question are: Occasionally. It works for some time, and encounters errors for other times. Errors are all over the place S3 connection failed error (unable to connect to S3 endpoint, failed to list S3 bucket), which…
dz902
  • 4,782
  • 38
  • 41
0
votes
1 answer

Autofilling Vertex Properties in GraphMappingConfig

I am Using AWS DMS to migrate schemas from MySQL to an AWS Neptune graph database. Part of this process is writing a GraphMappingConfig.json file. There isn't much documentation, but I am wondering, is there is a way to implicitly define vertex…
0
votes
0 answers

boto3 DMS delete DMS task logs

I am writing scripts in Python that are deleting DMS tasks using the boto3 package. I wonder if there is any way of programmatically deleting CloudWatch logging for the tasks? I can't find any option to do this with the…
0
votes
1 answer

how to enable CDC in google cloud sql server for AWS DMS replication?

I am trying to migrate data from GCP cloud sql server to AWS aurora MySQL using DMS CDC, for this I need to enable CDC on DMS source database which cloud SQL. As per the AWS documentation I need to enable CDC by executing "sp_cdc_enable_db" SP and…
Pand005
  • 1,095
  • 3
  • 23
  • 53
0
votes
0 answers

Does AWS DMS supports data migration from GCP Cloud server to AWS MySQL Aurora?

I am not finding clear AWS DMS documentation from migrating cloud (GCP) SQL server to AWS Aurora MySQL though, AWS provided on-premise and RDS as source but not GCP SQL server as source in documentation. So, my question is does DMS supports GCP sql…
Pand005
  • 1,095
  • 3
  • 23
  • 53
0
votes
1 answer

what is the syntax for aws dms describe_table_statistics in lambda function python?

I am trying to invoke replication task table statistics in aws lambda function but it's not printing anything. What is wrong with below syntax - filters=[] filters.append({'Name':'schema-name', 'Values':['dbo']}) …
Pand005
  • 1,095
  • 3
  • 23
  • 53
0
votes
1 answer

AWS DMS is failing on some collections

I'm trying to understand why 3 of my collections is failing during the migration. I got the error Execute bulk failed with errors: ‘invalid document for insert: empty key' but didn't managed to understand and solve this issue. I'm using DocumentDB…
Nir Berko
  • 1,368
  • 1
  • 13
  • 33
0
votes
1 answer

aws data migration service . start replication task issue

I have created AWS DMS replication instance, replication task and source, target enpoints using terrform. Now, when i run start replication task from windows aws cli . it throws this SSL error. Error running command 'aws dms start-replication-task…
CharlesDeeZee
  • 689
  • 1
  • 8
  • 20
0
votes
1 answer

Does Amazon DMS support replicating one table from a schema to a different schema of the same table?

I'm trying to setup replication between two MySQL RDS instances for one table only. I would like to replicate for example, schema1.users to schema2.users. Under Mapping rules, I'm able to specify the schema and table names but I think they are for…
0
votes
2 answers

AWS DMS "Unsupported or commented out DDL" when CDC is enabled on MySQL source

I am running an AWS Data Migration (DMS) job from RDS MySQL to a Redshift cluster, I have enabled detailed cloudwatch logs to capture the errors that are happening. I'm getting errors when insert and update statements are ran on the source MySQL DB…
Med Zamrik
  • 303
  • 2
  • 5
  • 14
0
votes
1 answer

AWS DMS task error for Aurora PostgreSQL migration

I am trying to migrate all the data present in my old RDS Aurora PostgreSQL cluster to the new RDS Aurora PostgreSQL cluster using AWS DMS. I have created the source and target endpoints and tested the connection successfully. However when I am…
0
votes
2 answers

CDC and replica using AWS DMS from oracle PeopleSoft to RDS postgreSQL

Can I do full load and CDC from oracle PeopleSoft to Amazon RDS postgreSQL using AWS DMS ?
Edy
  • 79
  • 5
0
votes
1 answer

Facing issue with few Tables which contains Dollar sign in the table name

I am using aws dms service to migrate my on-prem data to the rds database . Basically it is a homogeneous migration from oracle to oracle.I am able to migrate my data perfectly. I only faced issue related to one of my which dms is not able to…