We are currently using the default export data from DataVerse to Azure Data Lake. Then we read the data using the following guide. When we specify the inline dataset (CDM) and a linked service that is parameterized, we get an error.
DL Storage Gen2 should be able to handle parameterization, according to MS official documentation. But it seems that inline datasets are not able to handle it. So how are we supposed to parameterize a linked service when using CI/CD?
Thanks a bunch!
My own solution was to use filetransform step in Azure DevOps to replace the linked service URL.
Unlike native datasets, inline dataset does not have the provision of parameterization. A linked service is used to link your data store to the service. Linked services are like connection strings, which define the connection information needed for the service to connect to external resources. And dataset represents the structure of the data within the linked data stores, and the linked service defines the connection to the data source.
However, here (Azure synapse linked service) in UI, has a provision for parameterization but dataset when chosen as "inline", they don't match!
I couldn't find a clear documentation on the same, you can consider logging as support request or an issue here for an official response or share a feedback here, similar one
Inline datasets in ADF data flows do not yet support parameterized linked services. That work is currently under way and we are looking to enable that shortly.
