Azure Pipeline storage file trigger doesn't fire

Question

I´ve created an Azure Synapse Analytics Pipeline that must be triggered by the creation of a file within a Azure Gen2 storage account.

Somehow the blob creation event (i.e. when I upload the file in the corresponding container and folder) doesn´t fire anything and the pipeline does not start. I´ve registered the Microsoft.EventGrid and Microsoft.Synapse resource providers in the subscription, as suggested by the Microsoft official documentation.

Am I missing anything? As far as I know, and according to the Microsoft documentation and the many tutorials I've read, I don´t need any Event Topic/Event subscription...

Can you share your Trigger configuration? I do this often in Logic Apps, and the syntax for properly referring to the container/folder/file patterns can be finicky. — Joel Cochran, Oct 24 '22 at 17:40

score 0 · Answer 1 · answered Oct 25 '22 at 06:10

0

Can you please check the content type of the file :

usually when that is blank, event trigger is not initiated

answered Oct 25 '22 at 06:10

Nandan

3,939
2
8
21

Hi @Nandan, thank you very much for your reply and for your hint. The content type is in my case "application/json", so I guess it should be fine. – fbglv Oct 25 '22 at 07:17

score 0 · Answer 2 · answered Oct 25 '22 at 06:22

0

I tried to reproduce your scenario in my environment, and it works for me (i.e., when I upload the file in the corresponding container and folder). Let me share my implementation and then you can compare with yours.

enter image description here

This is the setup for the trigger

enter image description here

The trigger is firing as expected.

Files uploaded date time
Trigger firing date time

answered Oct 25 '22 at 06:22

Pratik Lad

4,343
2
3
11

Hi @PratikLad, thank you very much for your help! I have the exact some configuration as yours - and the trigger still doesn´t fire. Did you have to configure Azure EventGrid before you created the trigger in Synapse? – fbglv Oct 25 '22 at 08:40
No, I have not configured Azure EventGrid before creating trigger in synapse. Are you getting any error? if so, please share that. – Pratik Lad Oct 25 '22 at 08:52
Hi @PratikLad, I've got no error... the trigger simply doesn't fire. – fbglv Oct 25 '22 at 10:47

score 0 · Answer 3 · answered Nov 15 '22 at 07:52

I still didn´t figure out what is not working, so I implemented a workaround: a simple ADF pipeline looping for files in the landing zone. The pipeline is associated with a normal schedule trigger (it runs 3 times a day) and it calls in turn the pipeline I originally wanted to be triggered by the file creation trigger.

score 0 · Answer 4 · answered Mar 14 '23 at 10:20

Just an update: I´ve contacted the Azure Support and together with a representative we've been investigating the issue. It seems to be a very common problem, it occurs very often in several Azure implementations.

It seems the storage account where the event should be triggered has no event grid subscription associated to it. It should be however automatically created when the trigger is created and activated within Azure Synapse Workspace.

Azure Pipeline storage file trigger doesn't fire

4 Answers4