Stack Overflow
Stack Overflow

Questions tagged [aws-dms]

AWS Database Migration Service (AWS DMS) can migrate your data to and from most widely used commercial and open-source databases such as Oracle, PostgreSQL, Microsoft SQL Server, Amazon Redshift, Amazon Aurora, MariaDB, and MySQL. The service supports homogeneous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to MySQL. The source or target database must be on an AWS service.

http://docs.aws.amazon.com/dms/latest/userguide/Welcome.html

465 questions
0
votes
1 answer

i was migrating data from oracle to s3 using AWS DMS, DMS is reading LONG datatype as LOB and is skipping the entire column and data

I was migrating the data from Oracle DB to AWS S3 using DMS, In the Oracle DB in one of the table the datatype for the column is Long, but the dms while reading and transfering to S3 getting the below message in the Logs, replacing the actual column…
user9342493
  • 21
  • 5
0
votes
1 answer

what are the steps to be performed for Replication of AWS RDS Postgresql into On-Premise Postgresql using AWS DMS?

I have a requirement of replicating data from AWS RDS Postgres(12) Database to On-Premise Postgres(12) Database for disaster recovery purpose. I have found stuff about replication from On-premise to AWS RDS. But How can we implement it for AWS RDS…
Niki
  • 39
  • 6
0
votes
1 answer

DMS -get notified when replication task is completed

I need a way to get notified when the task finished rather it failed or Load complete const dms : AWS.DMS; const params = { StartReplicationTaskType: "reload-target", ReplicationTaskArn: "MyArn", …
Mina Fawzy
  • 20,852
  • 17
  • 133
  • 156
0
votes
1 answer

Can we use source database endpoints which are hosted on other servers than AWS server for using AWS DMS?

Can we use source database endpoints which are hosted on other servers than AWS server for using AWS DMS? If yes, can you help me by sharing any tutorials. I have seen this image in AWS official documentation. Thankyou!
VIMLESH KUMAR
  • 21
0
votes
1 answer

DMS task getting failed on Oracle on-going replication (Full load works fine)

We're using AWS DMS to migrate oracle databases into s3 buckets and after successfully running the full load on Oracle Database 19c Standard Edition 2 hosted in rds, the on-going replication is failing with error: Failed to add the REDO sequence…
mrejeb
  • 1
  • 3
0
votes
2 answers

DMS Task fail for EC2 oracle as source

Last failure message Last Error Endpoint initialization failed. Task error notification received from subtask 0, thread 0 [reptask/replicationtask.c:2859] [1020401] Cannot retrieve Oracle archived Redo log destination ids; Failed to set stream…
Saran K
  • 1
  • 2
0
votes
1 answer

Migrating Amazon RDS MySQL 5.6 to Amazon Auroa MySQL 5.7 Through AWS DMS

As the title of this topic is quite self-explanatory, The issue I am facing is that I am using "Ongoing Replication" as a replication type and everything is going well. Except for migrating the MySQL DB users, AWS DMS is unable to do that. Could you…
jarral rajput
  • 23
  • 6
0
votes
1 answer

Get data and control records using AWS DMS with Kafka as the target

I am using SQL Server RDS as the source database and Apache-Kafka as the target in AWS DMS. I want to receive both the data and control records on every CDC changes made in the source database but I am only getting data records in case of CRUD…
Chinmay Gupta
  • 21
  • 4
0
votes
1 answer

How to do trim columns when loading data using AWS DMS

I have to migrate tables using AWS DMS. While loading I have to trim the columns in source table and load it to target. I was not able to find any transformation rule for trim in AWS DMS. How it can be achieved?
Rajesh
  • 69
  • 1
  • 6
0
votes
2 answers

How can I join tables from different schemas into a single table?

I have multiple schemas (One for each client) with the same tables in Aurora - MySql. I want to collect the data from all the tables and create a new table in RedShift that would include all the columns from the source tables adding a new "schema"…
Javier González
  • 13
  • 3
0
votes
1 answer

Migrate and Transform MySQL rows from one table to another

I need to migrate all records 3 billions from one MySQL Aurora table to 5 different tables in same cluster . There are transformation of 2 columns is also has to happen . So when we migrate we need to convert xml to json and then json will be stored…
Sudarshan kumar
  • 1,503
  • 4
  • 36
  • 83
0
votes
0 answers

Table data not getting migrated while using AWS DMS to migrate data from Amazon Aurora RDS to Amazon Redshift

I have been trying to migrate the data from my source endpoint which is an Amazon RDS DB instance to my target endpoint which is Amazon Redshift. I am step-by-step following everything mentioned in the docs and my table is getting migrated…
Syed Kamran Ahmed
  • 27
  • 5
0
votes
1 answer

How do I identify modified rows using AWS DMS to Redshift?

I thought I had a simple question, but I am having a hard time finding an answer. This makes me suspicious that I'm asking the wrong question... I am new to Redshift... I am using a DMS migration task to pull data from a Sql Server database sitting…
Mike Bundy
  • 131
  • 2
  • 10
0
votes
0 answers

Can't connect MySQL to DMS via CA

I'm having troubles connecting MySQL database as a source endpoint on AWS DMS. Client sent me credentials (host, port, username, password) and certificates (CA cert, client cert, client key) and I successfully connected to DB with DBeaver. I tried…
robotic_arm13
  • 13
  • 3
0
votes
0 answers

Significant Reduction in file size after migration from SQL Server to S3(csv) using AWS DMS

I'm migrating about 2.5 Terabytes of data from an on-prem Microsoft SQL Server to Amazon S3 using DMS. It consists of 6 tables, 2 of which are 1.3TB and 1TB respectively. The migration of the 1.3TB table took 26Hrs. However, the data that is present…
Shitij Mathur
  • 385
  • 2
  • 10
1 2 3
…
30 31