0

I have set up an ADF pipeline to trigger whenenver a new file lands in the ADLS Gen2(source). The pipeline should copy the json file from ADlS(Gen2) and sink in Azure SQL db.

In ADF, I am using event based trigger: Type: BlobEventTrigger , Event : Blob Created

Here is the problem, I am facing

  • The ADF pipeline works file, when I manually upload the file to ADLS, to test/debug my ADF pipeline. The trigger get activated, the pipeline copies the data from ADLS to SQL db

  • However, when a file programmatically gets dropped in ADLS(as append blob), the trigger is not activated and thus ADF pipeline is not activated

I need to know:

  • How to create an event based trigger in ADF, when a append blob event occurs in ADLS

Tried both event types:

  • Ignore empty Blobs and Dont ignore empty blobs

1 Answers1

0

How to create an event based trigger in ADF, when a append blob event occurs in ADLS

you are appending the blob means you are updating/modifying the blob.

In ADF storage event triggers It will trigger the pipeline in two scenarios whenever the new blob is getting created and when the existing blob is getting updated.

I created a trigger to run pipeline when blob is created or updated in specific container. settings as below:

enter image description here

check the blob updated time and pipeline triggered time.

enter image description here enter image description here

Pratik Lad
  • 4,343
  • 2
  • 3
  • 11