Questions tagged [data-migration]

Data Migration is the movement of data from one location to another and can happen in many forms and many systems. One example of data migration is copying data from one database to another.

Data Migration is the movement of data from one location to another and can happen in many forms and many systems.

One example of data migration is copying data from one database to another.

1297 questions
12
votes
4 answers

Manually editing database in code first entity framework

I have been trying out EF 4.1 (code first) with MVC 3. I am thinking ahead to when the application will need changes. I tested a couple of scenarios. I like the idea of manually editing the database when the model (my POCOs) would changed. ASP.NET…
12
votes
3 answers

Migrating Redis to AWS Elasticache with minimal downtime

Let's start by listing some facts: Elasticache can't be a slave of my existing Redis setup. Real shame, that would be so much more efficent. I have only one Redis server to migrate, with roughly 3gb of data. Downtime must be less than 10 mins. I…
arrtchiu
  • 1,076
  • 1
  • 10
  • 23
11
votes
3 answers

mongoexport error: Failed: Failed to parse + Unrecognized field 'snapshot

Goal:to migrate my local mongodb data to mongobd atlas cluster. Try: 1. export local data as json. 2. import json to cluster. OS: Linuxmint 19.1 Cinnamon mongo --version MongoDB shell version v4.0.10 mongod --version db version v3.6.3 I also have a…
Annie
  • 345
  • 2
  • 5
  • 18
11
votes
2 answers

Doctrine 2 Migrations Workflow

I am developing a web application using Zend Framework 2 and Doctrine 2. I'm new to Doctrine 2 in general and Migrations in particular. I was wondering if there are any recommended best practices in using this. Some specific things I'm looking for:…
stase
  • 111
  • 4
11
votes
3 answers

accessing model manager methods in datamigration

I am trying to formulate a datamigration for one of my apps. I am using the reputation system mentioned here - django-reputation in my forward method, I have the following code - orm['reputation.reputation'].objects.log_reputation_action(user =…
Keval Doshi
  • 738
  • 6
  • 25
11
votes
1 answer

Getting Rails error "syntax error, unexpected tSYMBEG, expecting keyword_do or '{' or '('"

I am trying to migrate subject_id and course_id to the users table by typing: rails generate migration add_course_id_and_subject_id_to_users course_id:integer, subject_id:integer However, it results in the…
achilles77
  • 325
  • 2
  • 3
  • 11
11
votes
6 answers

Is there a Ruby database migration gem, that helps you move content from an old structure to a new structure?

Are there any Ruby gems/libraries that help you migrate from an old DB structure to a new structure? ActiveRecord migrations do a good job keeping track of a new db structure, but I wonder if there's something that helps you migrate an entire legacy…
btelles
  • 5,390
  • 7
  • 46
  • 78
10
votes
5 answers

Good tools for versioning REST models for Java

I am looking for good tools to support support changing the version of the model used in REST services. My dream tools would do something like: My pojo + version 1.0 config/transformer => Service available with 1.0 of my model My pojo + version 1.1…
Knubo
  • 8,333
  • 4
  • 19
  • 25
10
votes
2 answers

How to unit test a Django South "datamigration"

I created a data migration using south, that takes a versions table and converts it from: major: 1, minor: 2, micro: 3, release: a into a simpler: name: 1.2.3.a Now I want to test this datamigration using django unit testing (1.3beta). How can I…
Evgeny
  • 6,533
  • 5
  • 58
  • 64
10
votes
1 answer

How to migrate a existing one-to-many relationship to many-to-many in Rails and ActiveRecord

I have a model A, Class A < ActiveRecord::Base has_many: names, class_name: 'B' and a model B class B < ActiveRecord::Base belongs to :A and there are already a bunch of data in database. How do I write a migration to migrate them from…
dalef
  • 1,941
  • 1
  • 13
  • 18
10
votes
7 answers

SQL Server Copying tables from one database to another

I have two databases, one is called Natalie_playground and one is called LiveDB. Since I want to practice insert, update things, I want to copy some of the tables from the LiveDB to Natalie_playground. The tables I want to copy are called: …
Natalia Natalie
  • 647
  • 3
  • 10
  • 17
9
votes
2 answers

South doesn't create default permissions on new models in time for latter migrations to use them

I'm not 100% sure I'm doing this right, but I think I've found an issue where auth.Permission objects aren't being created soon enough for migrations to use them when you initialize a DB from scratch. The important details: I'm trying to initialize…
glenc
  • 3,132
  • 2
  • 26
  • 42
9
votes
4 answers

Core Data Migration - Can't find mapping model for migration

I followed the guide found here: http://www.timisted.net/blog/archive/core-data-migration/ but keep getting "Can't find mapping model for migration" when I start up the app with the new model. I've tried it in xcode 3 and xcode 4, multiple times,…
9
votes
3 answers

Data migration from MS SQL to PostgreSQL using SQLAlchemy

TL;DR I want to migrate data from a MS SQL Server + ArcSDE to a PostgreSQL + PostGIS, ideally using SQLAlchemy. I am using SQLAlchemy 1.0.11 to migrate an existing database from MS SQL 2012 to PostgreSQL 9.2 (upgrade to 9.5 planned). I've been…
iled
  • 2,142
  • 3
  • 31
  • 43
9
votes
3 answers

Best practices for temporarily enabling and disabling a MySQL user account?

I have a MySQL user account that is used (only) as part of the deployment process to make changes to the database (add/drop tables and columns, etc). Because this user account has these high privileges, I want to keep it disabled most of the time,…
Peter
  • 29,498
  • 21
  • 89
  • 122