0

I'm looking to automatically synchronise the data from an Azure SQL database to an Azure SQL data warehouse. It probably only needs to be inserting rather than updating, it will involve 25-35 tables and several million records in a few of the tables. (later on once the data is synced we may delete synced records from the source.)

Can anyone recommend some tools or approaches that could do this, suiting most of the requirements above?

I've looked at Data factory but that does not seem suited to incremental loads

Mark W
  • 11
  • 1

1 Answers1

0

The on-premise way would be a SQL Server Integration Services project. This would allow you to copy data both incrementally and in bulk, with any required transformations. Also see data flow documentation.

As noted by Peter Bons, this is not directly supported on the Azure platform. If you have a license for SQL server available, you can set up an Azure VM with SQL Server and SSIS.

For further discussion see

One note in those other questions is:

If you use Amazon Web Services, even the free version of the service allows you to create Ms SQL Server databases in the cloud that have the SSIS catalog and the Server Agent available

I can't vouch for that, but if a full SQL Server license is not something that is available, you might want to try it.

Iain Ballard
  • 4,433
  • 34
  • 39