Questions tagged [azure-mapping-data-flow]
38 questions
0
votes
1 answer
Mapping Data Flows - Working with Dynamic Business Keys
I am building a parameterised Mapping dataflow pipeline and have run into a problem that I need help with.
My ADF Load is based on a config file, a sample of which is given below:
I would like the ability to join using the Stagekeys column in my…
Sarath
- 221
- 2
- 9
0
votes
1 answer
How to embed SQL script in Azure Data Factory Mapping Data Flows Expression Builder
After executing my mapping dataflow I would like to run a clean-up script using the Post SQL Script option of the Sink activity.
However I'm not having much success with the expression builder.
This is what I've tried so far:
concat ( 'UPDATE…
user1309226
- 739
- 1
- 10
- 31
0
votes
1 answer
Where to use the Azure Data Factory Mapping Data Flow make sense?
My assumptions where MDF might be right fit are as follows:
MDF can be used as a Data Wrangling Tool by end-users
MDF is better suited for SQL Server-based Datawarehouse architectures to load the data into staging or data lake in clean format…
Cengiz
- 303
- 2
- 9
0
votes
1 answer
Alternative to MONEY Data type in Azure data factory
From an on-premise PostgreSQL DB I am trying to take it as source in the mapping data flow of Azure data factory. In postgreSQL DB table their is a column with values '$22.44', their(PostgreSQL DB) one can use MONEY datatype. Is their any…
Pushkar Wani
- 11
- 1
0
votes
2 answers
ADF Mapping Dataflow Temp Table issue inside SP call
I have a mapping dataflow inside a foreach activity which I'm using to copy several tables into ADLS; in the dataflow source activity, I call a stored procedure from my synapse environment. In the SP, I have a small temp table which I create to…
DiegoM
- 83
- 1
- 7
0
votes
1 answer
Azure mapping data flow - how to arrange transformations
I created an Azure Mapping Data Flow with Aggregate transformation that shows in the first row of the diagram below. Then I added a new branch to the Employee source, and then new data source Department. But, as shown in figure 2 below, when I try…
nam
- 21,967
- 37
- 158
- 332
-1
votes
1 answer
Azure data factory - multiple primary keys in source excel to be inserted in SQL database
I am working on a pipeline where I am using Excel as the source. The data has a primary key let's say Id, which is repeating multiple times in the Excel.
Now, when I insert it into a SQL database, it fails with the…
user961
- 453
- 6
- 20
-1
votes
1 answer
How to create a spread/range of consecutive dates in Azure data factory in derived transformation
I want to create a date spread from 01-01-2005 till 23-01-2015, is it possible to populate such a dates range in the Azure data factory (specifically in mapping data flows). If yes then which function should one use to apply the same.
Thank you!
Pushkar Wani
- 11
- 1