I've just uploaded several 10s of GBs of files to Azure CloudStorage.
Each file should get picked up and processed by a FunctionApp, in response to a BlobTrigger:
[FunctionName(nameof(ImportDataFile))]
public async Task ImportDataFile(
// Raw…
I am trying to develop in Azure portal an Azure Function (Node.js) that is triggered by Cosmos DB when create a doc. Azure documentation says that to do so, first i have to select "Cosmos db trigger" from templates, but no templates appear in my…
I have created a collection in cosmosDB with a unique key. Ideally collection should be updated with new values if an existing key is entered as input for the collection.
I have an Azure cosmosDB trigger function which is configured the above…
I have to update a cosmosDB Collection(let be collection-1) based on value of a column in another cosmosDB Collection(let be collection-2). The collection-1 should be updated with values from other collections like collection-3 and collection-4. i…
We are using azure function to process the documents uploaded on azure storage blob. We need to send an email after successful uploading of all documents on blob(i.e. 50 file at one time) as uploading status.
How we can get the status that all files…
I am working on pipeline that copies data from ADLS Gen into Azure Synapse Dedicated SQL Pool. I used the Synapse pipelines and followed the Microsoft Docs on how to create a storage event trigger. But when a new file is loaded into the ADLS, I get…
My azure functions can take 30-40 minutes to complete.
As you can see in the below image, 230 seconds is the maximum amount of time that an HTTP triggered function.
So, i am trying to create an azure service bus triggered function. Wanted to know…
I have created a pipeline with a trigger:
I want this pipeline to run every time I pr with "v3.*" as the tag. Now I create a new pr:
However, the pipeline doesn't run. Am I doing something wrong here?
Thanks very much!
I am new to Azure Data Factory. With help from my colleagues we created a pipeline to import data from an external system. We scheduled a trigger to run every two hours (5AM, 7AM, 9AM... 11PM). The trigger ran 5AM and 7AM, but missed the 9AM run by…
I have an event based trigger that set on an data lake gen 2 folder. I need to trigger my pipeline only once for all these 20 files together. But now when these 20 files are loaded at a time, the event based trigger is triggering the pipeline for…
I have several scripts on the "azure virtual machine" that run once a day at a certain time, extract data from several web services and push the extracted data into the "azure database for postgresql server".
I want these scripts to run from the…
I have an ADF pipeline that I need to run based on a csv file containing sporadic dates.
Is there anyway to implement this? my only thought is to trigger a pipeline daily that has a databricks script that checks if the current date matches a date in…
I understand that Azure Function - Azure Storage Queue triggered functions are triggered on a polling basis.
But cant seem to find how it work for Azure Service Bus queues. Does it also follow the polling approach or has a session with the Azure…
I need a Pipeline to trigger on the Monthend week (Tues, Wed, Thurs and Friday) of a month.
Monthend is defined as,
"Last but one" Friday Or
Second Friday from the end of the month.
For Example, For month of June 2021, 18th is the Monthend (Orange…
I have created a logic app and I want it to trigger when a new blob is added to a storage account. As soon as I add this trigger, the following error comes, its not very descriptive and not sure which permissions is it not seeing.
Please check your…