Questions tagged [aws-dms]

AWS Database Migration Service (AWS DMS) can migrate your data to and from most widely used commercial and open-source databases such as Oracle, PostgreSQL, Microsoft SQL Server, Amazon Redshift, Amazon Aurora, MariaDB, and MySQL. The service supports homogeneous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to MySQL. The source or target database must be on an AWS service.

http://docs.aws.amazon.com/dms/latest/userguide/Welcome.html

465 questions
3
votes
2 answers

Replicate views from Postgres to Postgres on AWS DMS

I'm using AWS DMS to migrate data from one Postgres database to another Postgres database. Everything works fine, except one thing: the views are no replicated on my target database. I've read that this cannot be done between heterogenous database…
Daniel Pereira
  • 2,720
  • 2
  • 28
  • 40
3
votes
1 answer

CDC change data capture start time - Postgres replication

I'm using AWS DMS for Postgres-postgres migration. For on-going replication for other engines there is a parameter CDC start time where we can specify the start time of picking up up changes for replication but unfortunately postgres does not…
RMu
  • 817
  • 2
  • 17
  • 41
3
votes
1 answer

Two way syncing between local mysql database and AWS RDS

my question is pretty similar to Two way syncing between on-premise SQL Server database and Azure SQL database but i want it between my on premises mysql and AWS RDS instance. So functional need is when i am within organization connected to local…
newCode
  • 178
  • 1
  • 3
  • 15
2
votes
1 answer

AWS DMS (source MongoDB, target PostgreSQL) need to extract info from _doc column using transformation rule, in document mode

I'm running some tests of transform rules for the AWS Database Migration Service (DMS). The source database is MongoDB (I'm using AWS DocumentDB) and the target database is PostgreSQL (I'm using AWS RDS). I'm using "document mode" (as opposed to…
rharrington
  • 53
  • 1
  • 4
  • 8
2
votes
0 answers

AWS DMS replication instance and target endpoint test connection failed

I am trying to start a replication task but for that I need the test connection to work between the target endpoint (S3) and the replication instance. Here's the error: Test Endpoint failed: Application-Status: 1020912, Application-Message: N/A,…
2
votes
0 answers

Disable default value of a column in Postgresql

I know how to remove or set the default value of a column in PostgreSQL. ALTER TABLE products ALTER COLUMN price DROP DEFAULT; ALTER TABLE products ALTER COLUMN price SET DEFAULT 7.77; However is there a way to disable the default value of a…
Ali Mohsan
  • 326
  • 2
  • 15
2
votes
1 answer

AWS DMS - PostgreSQL invalid input value for enum and daterange

I'm performing a logical replication from our PostgreSQL server to AWS RDS, using the database migration tool (DMS). Most tables were migrated successfully, but I'm having troubles with a couple of the tables. When I run the task to load the table,…
Adcade
  • 151
  • 7
2
votes
1 answer

How can I destroy a specific Terraform managed resource?

I have a DMS task that failed and isn't resuming or restarting. Unfortunately, according to AWS Support, the only recourse is to destroy and recreate it. I have a large infrastructure that takes several hours to destroy and recreate with…
alan
  • 6,705
  • 9
  • 40
  • 70
2
votes
0 answers

Replicate PostgreSQL View As Source and DynamoDB as Target Using Amazon DMS

I am trying to migrate PostgreSQL view to a DynamoDB table using Amazon DMS. Here's my table mapping for the DMS task: { "rules": [ { "rule-type": "selection", "rule-id": "1", …
dossani
  • 1,892
  • 3
  • 14
  • 23
2
votes
1 answer

AWS DMS Source MongoDB and Target RDS Postgres Full load not happening but ongoing replication happens

I created a DMS task: Source - MongoDB Target - RDS Postgres I have successfully working pipelines with full load + Ongoing replication working. But for some collections in my source mongo when I create Full load or Full load + Ongoing…
Aim_headshot
  • 111
  • 1
  • 6
2
votes
1 answer

Connecting AWS DMS to Redshift Serverless?

I've tried using the workgroup endpoint, and Redshift-managed VPC endpoints, but get the error message: Cluster 'XXXXX' does not exist. Does that seem like a VPC issue, or is there a quirk re Redshift Serverless? Anyone using this combo?
Mike Karp
  • 1,477
  • 13
  • 19
2
votes
1 answer

How to enable logical replication for an RDS PostgreSQL DB instance ? for DMS?

The scenario is that I want to CDC a table from a RDS postgreSQl to a RDS postgreSQL. However my data migration task is not working and having this error Last Error Unable to use plugins to establish logical replication on source PostgreSQL…
Chau Loi
  • 1,106
  • 1
  • 14
  • 36
2
votes
1 answer

No Data appearing in Redshift from MongoDB using AWS DMS

I am trying to test the AWS data migration service to fetch some data from Atlas MongoDB to Redshift cluster, I have created the replication instance, both the endpoints, successfully tested the connection them and created the replication task, the…
abhishake
  • 131
  • 1
  • 12
2
votes
1 answer

The Distributor has not been installed correctly. Could not enable database for publishing

I am using an AWS-DMS instance to migrate and replicate an on-premises database to another SQL instance in the AWS cloud. When I use a migration task of type Full load, the instance successfully executes the migration, but with the same Mapping…
2
votes
0 answers

AWS Data Migration Service (DMS) source engine PostgreSQL vs Amazon Aurora PostgreSQL

We are migrating data from a couple of Aurora instances to our own single Aurora instance. All of them run Postgres. I realized that some of our tasks are configured to use PostgreSQL while others are configured to use Amazon Aurora PostgreSQL. Now…
Keshav Potluri
  • 479
  • 5
  • 15