0

I need to schedule an event based trigger which will check for a file every 15 minute and there is max run window of n minutes for the pipeline to complete(This includes the wait time for the file). What settings in adf can serve this kind of scenario?

Thanks in advance!

I am thinking of azure logic apps along with Webhooks but not very sure.

Joydeep roy
  • 31
  • 1
  • 1
  • 2

1 Answers1

0

Set up a schedule trigger to run every 15 minutes. This will be the trigger that checks for the file periodically.

Define an input dataset representing the file you're waiting for.

To set a maximum run window for your pipeline (including waiting time for the file), you can use an Execute Pipeline activity that wraps around your main processing activities. configure the Timeout property of the Execute Pipeline activity to your desired maximum run time.

I can be more specific if you tell me where the file will hit.

Also see:

How to create Event Trigger in Azure Data Factory when three files created in Azure Blob Container?

https://www.youtube.com/watch?v=FpKrBLeqdj4 (this not exactly regarding your problem but might be helpful)

Ziya Mert Karakas
  • 572
  • 3
  • 15