1

I am reading an SQL DB as source and it outputs the following table.

enter image description here

My intention is to use data flow to save each unique type into a data lake folder partition probably named as specific type.

I somehow manage to create individual folders but my data flow saves the entire table with all types into each of the folders.

my data flow

enter image description here

Source

enter image description here

Window

enter image description here

enter image description here

Sink enter image description here

enter image description here

Any ideas?

wwnde
  • 26,119
  • 6
  • 18
  • 32

2 Answers2

1

I create a same csv source and it works well, please ref my example.

Windows settings: enter image description here enter image description here

Sink settings: choose the file name option like this enter image description here

Note, please don't set optmize again in sink side.

The output folder schema we can get:

enter image description here

Just for now, Data Factory Data Flow doesn't support custom the output file name.

HTH.

Leon Yue
  • 15,693
  • 1
  • 11
  • 23
-1

You can also try "Name folder as column data" using the OpType column instead of using partitioning. This is a property in the Sink settings.

enter image description here

Mark Kromer MSFT
  • 3,578
  • 1
  • 10
  • 11