Stack Overflow
Stack Overflow

Questions tagged [azure-purview]

a unified data governance service on Azure that helps you manage and govern your on-premises, multicloud, and software-as-a-service (SaaS) data.

135 questions
1
vote
1 answer

Azure Purview - Scan file types

We are scanning an Azure Data Lake (Gen 2). In the scan results we get some files that we don't want to appear in the asset register - for example, a configuration file (.wmk) as per the below. If there any way to hide all files of a certain type? I…
Murray Foxcroft
  • 12,785
  • 7
  • 58
  • 86
1
vote
1 answer

Azure Purview - Deleted folders in ADLS2

We are scanning ADLS Gen 2 data lake successfully with Purview. However, if a folder is deleted in the lake and you re-scan, the scan does not remove the deleted folder. The deleted folder remains in Purview, but the last modified date (from the…
Murray Foxcroft
  • 12,785
  • 7
  • 58
  • 86
1
vote
1 answer

Lineage not created when scanning Delta table in Azure Purview

A delta table is created from data bricks under the Azure blob storage container by providing its mount path. It is scanned in Azure purview using the Azure blob storage asset, the Lineage is not generated. It would be helpful if any suggestion to…
Vignesh G
  • 151
  • 6
1
vote
2 answers

Perform Azure Purview Scan thru API

I have registered the source (ADLS2) thru Azure portal and have done the initial scan. I am aware that I can schedule the scan. But I would like to know if I can perform source scan in Azure Purview thru an API. I have gone thru the below link but…
usr_lal123
  • 650
  • 12
  • 28
1
vote
1 answer

Azure Integration Runtime Cross Service Utilization

I have successfully created a runtime in DataFactory and have stuff running. When I go to create another runtime in Azure Purview, it prompts to remove or repair which results in the lose of the ADF one. How can I utilise the same runtime on…
wwnde
  • 26,119
  • 6
  • 18
  • 32
1
vote
0 answers

Unable to scan azure sql database using azure purview

Click to see the image stored the connection string in azure key vault. I added the access policy that azure purview can access the azure key vault. My connection string is : Server=tcp:imagevalidation.database.windows.net,1433;Initial…
Thaarani S
  • 19
  • 1
1
vote
2 answers

Connecting Integration runtime to azure data factory and purview

I want to use azure data factory to load data from my on-prem server to azure, and I would also scan my on-prem server using purview. How can I scan the same server using one integration rutine and not manually changing it every time?
AstridM
  • 11
  • 1
1
vote
1 answer

Best practice for inferring schema from a CSV file in a raw ingestion layer of a data lake?

Is there a best practice for inferring schema in a raw ingestion layer of a data lake (not schema validation, just infer data types and column names)? I am using Azure and want to design a way to validate the schema downstream from the ingestion…
Rowan Neri
  • 11
  • 2
1
vote
1 answer

Azure Purview Sources missing from register sources option (SAP, HIVE, S3, "Multiple Sources")

Looking to register all the Data Sources in a subscription/account but the option for "Azure (Multiple Sources)" is missing. As are other sources (HIVE, SAP, AWS S3). Why would this be the case?
user15037183
  • 47
  • 1
  • 5
1
vote
2 answers

Unable to connect Azure purview from Azure Synapse

I followed the documentation for connecting azure purview account with synapse. I do not see option - Manage -> Azure Purview in Synapse Workspace.
akshat thakar
  • 1,445
  • 21
  • 29
1
vote
1 answer

How does Azure Purview perform Data Lineage in Azure Data Factory when there are multiple Copy Data Activities on the same Source?

My particular scenario is this: Data Factory Pipeline I have a .txt file in Azure Blob Storage. I copy this file in Blob to Azure SQLDB I copy the same file to archive location in the same blob container I then delete the file after it's…
Trent Tamura
  • 1,079
  • 6
  • 16
1
vote
1 answer

ODBC connectivity for Azure Purview

Azure Data Catalog gen1 allowed us to get metadata from tables inside a Databricks workspace, by using ODBC connection. Do we have have ODBC connectivity for Azure Purview too? If so, can someone share the details?
Saravanan
  • 49
  • 6
1
vote
0 answers

Why All the Dataflows don't appear in purview after a Debug?

I've a pipeline in the Azure Datafactory that's linked to the Azure purview to monitor changes. Once I debug the pipeline the copy activity and the Dataflow appeared in the Azure purview. Now I altered the dataflow a little and run the pipeline. But…
Anudeep_Akula
  • 23
  • 4
1
vote
0 answers

Azure Purview fails to classify Azure Data Explorer databases

I followed the documentation for scanning ADX assets with Azure Purview, created an active connection with all the required permissions, and triggered a scan. The scan was successful, but no assets (tables, columns, etc) were identified. I tried…
Manu Cohen Yashar
  • 169
  • 2
  • 7
1
vote
1 answer

Azure Purview support for Delta Format sink in Data flow of ADF

I was recently exploring Azure Purview and was trying to push lineage information from ADF to Azure purview. However, it seems when we sink data in Delta Format using dataflow in ADF (Which is a inline format for data flow), it doesn't capture the…
Anish Kumar Sarangi
  • 15
  • 2
1 2
3
…
8 9