Stack Overflow
Stack Overflow

Questions tagged [azure-adf]

The Azure Data Factory (ADF) is a service designed to allow developers to integrate disparate data sources

35 questions
1
vote
0 answers

Not able to generate ARM template

Generating ARM templates Failed to save Arm Templates. Error: {"$id":"1","innerException":null,"message":"The path '/ARMTemplateForFactory.json' specified in the add operation already exists. Please specify a new path.\r\nParameter name:…
rani chukka
  • 11
  • 2
1
vote
1 answer

Convert JSON file from google analytics to SQL table

I'm trying to get data from google analytics v4 with ADF. The output are JSON files. Now I'm trying to convert the JSON files to an SQL table. Only the format of this JSON is different than I used to deal with. The columnheader are only shown above…
M39913
  • 11
  • 2
1
vote
1 answer

ADF dataflow and columns/rows in separate array in JSON

I have a bunch of json files which have an array with column names and a separate array for the rows. I want a dynamic way of retrieving column names and merge them with the rows for each json file. Been playing around with derived columns and…
Jokkvahl
  • 11
  • 2
1
vote
0 answers

Creating Azure Data Factory Linked Service with Terraform Creates Link in Live Mode

When I create a linked service in Azure Data Factory (ADF) for Databricks with terraform (using azurerm_data_factory_linked_service_azure_databricks) the linked service shows up only in live mode. How can I make the linked service available in GIT…
techtech
  • 31
  • 5
1
vote
1 answer

Copying single csv with multiple schema in ADF

Hi I am trying to sink csv file to databse using ADF and Data Flow CSV file structure as below r1c1,r1c2,r1c3,r1c4 r2c1,r2c2,r2c3,r2c4 r3c1,r3c2,r3c3,r3c4 r4c1,r4c2,r4c3,r4c4,r4c5,r4c6 r5c1,r5c2,r5c3,r5c4,r5c5,r5c6 so 2 schemas one with 4 columns…
Rahulkumar Patil
  • 11
  • 1
1
vote
1 answer

The gateway did not receive a response from 'Microsoft.DataFactory' within the specified time period

I am trying to configure git (github) for my existing data factory. I am getting this error: The gateway did not receive a response from 'Microsoft.DataFactory' within the specified time period.
sparsh agarwal
  • 15
  • 1
  • 5
1
vote
1 answer

ADF error when reusing parameter in replace function

I am parameterizing a Linked Service (SQL server) in ADF, but have trouble reusing parameters for different service properties as Dynamic Content. I have created more parameters for the SQL Server…
dotnetguru.dk
  • 13
  • 2
1
vote
1 answer

Azure ADF using Azure Batch throws Shared Access Signature generation error

I am working on a simple Azure Data Factory pipeline where I have simply added a Batch Service and in that specified the Batch Service account (which I have created thru linked service and tested the connection is working). In the command I am just…
user42012
  • 722
  • 12
  • 33
0
votes
1 answer

Synapse Pipeline : DF-Executor-OutOfMemoryError

I am having nested json as source in gzip format. In Synapse pipeline I am using the dataflow activity where I have mentioned the compression type as gzip in the source dataset. The pipeline was executing fine for small size files under 10MB. When I…
Ritesh S
  • 1
  • 1
0
votes
1 answer

ADF Error code 2011: Required property 'connectionString' is not provided in connection properties

I am trying to connect to snowflake using linked service and copy data from adls to SF using adf pipeline. I created the linked service and tested the connection. It works fine. Even the debug over the pipeline works fine. althogh when I manually…
pikapika
  • 1
  • 1
0
votes
1 answer

How to read XML file from web activity data in ADF

For example this is the output I get from Web activity: `{ "Response": " Max …
pikapika
  • 1
  • 1
0
votes
1 answer

Send email notification failure Azure data factory Pipeline not working (Web Job)

I have a pipeline where the following activities takes place Lookup-> Lookup ->ForEach->(Stored Procedure)-> Send Success Email/ Send Failure Email Once the pipeline successfully completed its execution, I see a successful email in my inbox,…
Sayeed Ahmed
  • 57
  • 9
0
votes
1 answer

Error while making dataset Connection with Snowflake in Azure ADF dataset

I have two linked services one for SQL and other for Snowflake.While making snowflake dataset connection in ADF it throws below error: Error details Error code 9602 Details ERROR [22000] Cannot perform SELECT. This session does not have a current…
Divya Pardeshi
  • 11
  • 1
0
votes
1 answer

How to install Azure ADF SelfHosted IR ON VM in quiet mode command line

I am using Azure and in Azure i created an Azure Data Factory Then i am try to install Self Hosted IR on my VM https://www.microsoft.com/en-us/download/details.aspx?id=39717 Documentation does not tell what parameters i need to pass to this msi when…
knowdotnet
  • 839
  • 1
  • 15
  • 29
0
votes
0 answers

Storage event Trigger in Azure ADF

I have to create a storage event trigger to process a file created on BLOB . While creating it is asking me for storage account and container name. I need to put the values dynamically as I have different storage account name for different…
Saikat Banerjee
  • 1
  • 1
1
2 3