Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
0
votes
1 answer

Azure Synapse Link for Dataverse not creating folder "OptionsetMetadata" with Power Apps

I have created the following Azure Synapse Link for Dataverse: According to Microsoft documentation, after creating an Azure Synapse Link, the following five tables are created in a folder named OptionsetMetadata in Azure Data Lake Storage…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
2 answers

Content of directory on path https://xxxxxxx.dfs.core.windows.net/dataverse-xxxx-org5a2/account/Snapshot/2018-08_1656570292/*.csv' cannot be listed

When I try to query our Serverless SQL pool in Azure Synapse Analytics I get the following error: "Content of directory on path 'https://xxxxxx.dfs.core.windows.net/dataverse-xxxxxx-org5a2bcccf/account/Snapshot/2018-08_1656570292/*.csv' cannot be…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

External table 'logdata' is not accessible because location does not exist or it is used by another proces

I am try to create an external table on Azure Synapse by once I run select * from logdata I get the error "External table 'logdata' is not accessible because location does not exist or it is used by another proces" below is my code CREATE DATABASE…
Muimi
  • 1
  • 1
0
votes
1 answer

Unable to connect to a MongoDB from Azure synapse

Unable to connect to a MongoDB from copy activity as a timeout error occurs in just 30 seconds. The MongoDB seems to be online. I am able to test the connection successfully inside the copy activity. However, when I run the pipeline the following…
Baobab
  • 5
  • 3
0
votes
3 answers

Importing one to many relations in a Join transformation Azure Synapse

I have two data sources that are loaded into Azure Synapse. Both raw data sources contain an 'Apple' table. I merge these into a single 'Apple' table in my Enriched data store. SELECT * FROM datasource1.apple JOIN datasource2.apple on…
atoms
  • 2,993
  • 2
  • 22
  • 43
0
votes
1 answer

Azure Synapse Serverless query wildcard performance

I'm trying to query parquet files from my abfss v2 container. That data is structured like this: daily/pricedate=2018-04-01/part-0.parquet ... daily/pricedate=2022-11-16/part-0.parquet If I do this query (note the result.filepath(1) in the select…
Dean MacGregor
  • 11,847
  • 9
  • 34
  • 72
0
votes
2 answers

How to Drop a Table In Synapse SQL Database Serverless Pool Builtin

I am trying the following code to drop a table in Azure Synapse drop dbo.tablename drop tablename But I keep on getting errors such as: Unknown object type 'ts_originationopportunity' used in a CREATE, DROP, or ALTER statement. Or Unknown object…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

Synapse/ADF pipeline error 2200 on upserting CSV into on-prem SQL-server table

In my pipeline I perform an upsert from a flat CSV file (semicolon separated) into a table in our on-premise SQL-server. At first all the data types from the CSV file are read as STRING and I did the same with the SQL table, which means that I set…
AntonyJ
  • 29
  • 6
0
votes
2 answers

Copy data from Synapse instance to another instance

Is there a way to copy data from all tables in a Synapse instance to another? Considered Data Migration Assistant, but it doesn't allow to select Synapse as Source. Also, I am considering to use Copy activity in a pipeline, but the number of tables…
bjnr
  • 3,353
  • 1
  • 18
  • 32
0
votes
1 answer

Azure Mysql server connection with Azure Synpase Spark doesnt work

I´m trying to connect to an Azure Mysql database server to create a table from a Dataframe in Azure Synapse with Spark. I have this url and this properties All variables like jdbcXYZ are fulled with the correct values from the database import…
Jose
  • 25
  • 1
  • 5
0
votes
0 answers

What is the TSQL for Bulk Insert?

Azure Synapse has the Bulk Insert option in its GUI for inserting tables. But what is the underlying code that it is running? I would like to run it as TSQL rather than as a pipeline. The documentation is unclear that is even supported while…
John Stud
  • 1,506
  • 23
  • 46
0
votes
1 answer

Move Entire Azure Data Lake Folders using Data Factory?

I'm currently using Azure Data Factory to load flat file data from our Gen 2 data lake into Synapse database tables. Unfortunately, we receive (many) thousands of files into timestamped folders for each feed. I'm currently using Synapse external…
DavidStein
  • 3,149
  • 18
  • 41
  • 62
0
votes
1 answer

How terminate pipelines in Azure Synapse when query returns no rows

I have a pipeline A that is invoke by a main pipeline D. It invokes 2 other pipelines B and C. When pipeline A is invoked an extraction query is executed that can return rows or nothing. In case it returns no rows I would like it to terminate…
Baobab
  • 5
  • 3
0
votes
2 answers

Azure Synapse Error 208 - "Invalid object name" after load from csv

I have a pipeline that loads multiple csv's and an xlsx file into 4 separate tables. Generally, this pipeline runs fine. However, occasionally one of the tables (always the same table) results in an invalid object. If I re-run the pipeline with no…
John Gretton
  • 1
0
votes
0 answers

Different dataframe Count results with different pool sizes while using PySpark in Synapse Analytics

To build up our historical layer of our lakehouse architecture we're reading csv files and saving them as delta tables. Part of this logic is to do a simple count() operation to check if the amount of new records complies with what we're…
justsander
  • 91
  • 5
1 2 3
…
99 100