0

I am creating an Azure Data factory to copy binary files from the Google Cloud Storage bucket to the Azure Blob Storage container. The files need to be copied without any compression. I want to specify fault tolerance settings to skip files with invalid names and skip forbidden files but those options are disabled when I create the copy pipeline using Azure portal.

enter image description here

Source and Sink configurations are as follows

enter image description here

What are the ways,if I want to use such fault tolerance configurations -

 "skipErrorFile": { 
        "fileMissing": true, 
        "fileForbidden": true, 
        "dataInconsistency": true,
        "invalidFileName": true        
    },

Tried editing the JSON code representation of the factory, the changes don't reflect after publishing. Experts, please help.

Shalaka Deshpande
  • 156
  • 1
  • 9

1 Answers1

1

When I tried to apply fault tolerance, I got the same issue only one option is enabled for me while copying binary data from blob storage to ADLS gen 2.

enter image description here

I have added blob data contributor role to the storage account and tried with below source dataset:

enter image description here

I tried to apply fault tolerance below three options are enabled:

enter image description here

As per this

enter image description here

So, I have given a folder which is having list files then I was able to enable all options as mentioned below:

enter image description here

Maku sure you have given all permissions to your source dataset.

Bhavani
  • 1,725
  • 1
  • 3
  • 6