Stack Overflow
Stack Overflow

Questions tagged [data-migration]

Data Migration is the movement of data from one location to another and can happen in many forms and many systems. One example of data migration is copying data from one database to another.

Data Migration is the movement of data from one location to another and can happen in many forms and many systems.

One example of data migration is copying data from one database to another.

1297 questions
6
votes
1 answer

Syncrhonizing 2 database with different schemas

We have a normalized SQL Server 2008 database designed using generic tables. So, instead of having a separate table for each entity (e.g. Products, Orders, OrderItems, etc), we have generic tables (Entities, Instances, Relationships, Attributes,…
Mosh
  • 5,944
  • 4
  • 39
  • 44
6
votes
3 answers

Database migrations for SQL Server

I need a database migration framework for SQL Server, capable of managing both schema changes and data migrations. I guess I am looking for something similar to django's South framework here. Given the fact that South is tightly coupled with…
Art
  • 23,747
  • 29
  • 89
  • 101
6
votes
1 answer

RDS MySQL Data to a Flat File to Reload in another MySQL - Std CLI Not Working

To establish precident I reviewed the following: Amazon-RDS database to Dedicated server Mysqldump of the AWS RDS I have not however found a clear cut solution to my issues in these, and only ancillary factoids throughout - I wanted to put…
cerd
  • 2,171
  • 1
  • 18
  • 28
6
votes
2 answers

How to migrate single-token cluster to a new vnodes cluster without downtime?

We have Cassandra cluster with single token per node, total 22 nodes, average load per node is 500Gb. It has SimpleStrategy for the main keyspace and SimpleSnitch. We need to migrate all data to the new datacenter and shutdown the old one without a…
relgames
  • 1,356
  • 1
  • 16
  • 34
6
votes
2 answers

Updating 4 million records in SQL server using list of record-ids as input

During a migration project, I'm faced with an update of 4 millions records in our SQL Server. The update is very simple ; a boolean field needs to be set to true/1 and the input I have is a list of all the id's for which this field must be…
Jay Regal
  • 3,243
  • 1
  • 16
  • 18
6
votes
2 answers

How to update a TIMESTAMP column to TIMESTAMP WITH TIME ZONE in Oracle

I have a pair of columns that were unfortunately defined incorrectly as TIMESTAMP(6) instead of TIMESTAMP(6) WITH TIME ZONE. I would like to migrate those columns from the old, wrong datatype to the new, correct one. On top of that, the values…
Hank Gay
  • 70,339
  • 36
  • 160
  • 222
5
votes
1 answer

Complex data migration in the Data-tier Application Framework (DAC Fx)

I am excited to make the leap to using DAC Fx and declarative database development. The major obstacle for me is how to handle complex data migrations across several different versions of the schema. In the old world, we can simply run all of our…
lu.s.benjamin
  • 51
  • 2
5
votes
3 answers

What is the purpose of RoundhousE's RestoreRun mode?

According to the documentation, RoundhousE has 3 modes: Normal DropCreate RestoreRun The first 2 are clear, but I don't understand RestoreRun Mode and the benefit it offers in Production: Once you have gone to production, you switch from…
Joel Beckham
  • 18,254
  • 3
  • 35
  • 58
5
votes
1 answer

MySQL to MongoDB Data migration

We know that MongoDB has two ways of modeling relationships between relations/entities, namely, embedding and referencing (see difference here). Let's say we have a USER database with two tables in mySQL named user and address. An embedded MongoDB…
def __init__
  • 1,092
  • 6
  • 17
5
votes
3 answers

AWS DMS task fails

Having some problems using DMS - misconfigure the task selection rule (i guess) testing it between 2 small rds postgres instances created source and target endpoints created a replication instances ( tested connections successfuly ) The task i run…
Eyal Solomon
  • 470
  • 1
  • 6
  • 15
5
votes
2 answers

Data Migrations and AppEngine

I've done a lot of development in rails, and am looking into developing projects using python & app engine. From the demo project and what I've seen so far, I've got a question/concern about app engine projects: How is data migration handled in…
stringo0
  • 2,720
  • 7
  • 38
  • 52
5
votes
1 answer

use c# to copy table data from oracle to SQL Server?

Could you kindly tell me whether there is a most convenient way to copy table data from oracle to SQL Server? My only idea is iterate all rows and do insert operation. That means i should write lots of code. I want to know may I use…
user622851
  • 177
  • 2
  • 13
5
votes
1 answer

Moving data between different servers in oracle

I'm new to Oracle, and I am working on moving specific data from a DB on one server to the DB on another server. The two DBs have the same schema, but I want to pull specific columns referenced by their keys and move the data into other server. I'm…
null
  • 131
  • 1
  • 3
  • 8
5
votes
0 answers

Mongodb Migration Threshold Controls?

I'm seeking a way to control sharded collection migration thresholds in mongodb. These thresholds are described at https://docs.mongodb.com/manual/core/sharding-balancer-administration/#sharding-migration-thresholds What I see in those values is…
Bill
  • 131
  • 1
  • 5
5
votes
1 answer

Invalid operation: The total size of the json object exceeds the max limit of 4194304 bytes Details

I am trying to migrate big query event data in redshift database. I am using following command. COPY events_20180627 from 's3://big-query-to-rs/big-query-data/events_20180627' CREDENTIALS…
iamabhaykmr
  • 1,803
  • 3
  • 24
  • 49
1 2 3
…
86 87