Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
0
votes
1 answer

How to drop a clustered columnstore index?

How can I drop a clustered columnstore index on a table? I am trying to alter the length of a column, but getting this error: The statement failed because a secondary dictionary reached the maximum size limit. Consider dropping the columnstore…
John Stud
  • 1,506
  • 23
  • 46
0
votes
2 answers

Azure Synapse pipeline parse xml data to rowset

In Azure Synapse pipeline I adjust loading from stage table to DWH on Azure Synapse SQL dedicated pool. I have a source table where one column has xml data stored in the column as text (nvarchar(max)). I need parse this xml from every row in the set…
niko
  • 11
  • 1
0
votes
2 answers

Copy CSV File with Multiline Attribute with Azure Synapse Pipeline

I have a CSV File in the Following format which want to copy from an external share to my datalake: Test; Text "1"; "This is a text which goes on on a second line and on on a third line" "2"; "Another Test" I do now want to load it with a Copy Data…
Andreas
  • 1
  • 2
0
votes
1 answer

Error while ingesting data into dataverse using Synapse dataflow (Sustainability Manager)

I'm trying to load data into dataverse using Azure Synapse pipelines (Dataflows). Sink: Dataverse table - Mobile combustion (https://learn.microsoft.com/en-gb/common-data-model/schema/core/industrycommon/sustainability/mobilecombustion) Below are 4…
Kuldeep Singh
  • 517
  • 6
  • 26
0
votes
1 answer

How to user pipeline parameters to change sink dataset paths in Synapse Analytics

I've a Azure Synapse Pipeline that has some copy activities with parquets sinking datasets. My pipeline that runs the copy activities has a string date parameter. How to I pass this date parameters to the sink dataset and use it in the path of the…
Gabriel Padilha
  • 121
  • 8
0
votes
1 answer

Limit query time on Azure Synapse Analytics

On Azure Synapse Analytics, users can inadvertently run very resource-consuming queries over potentially large amounts of data. On SQL Server, it's possible to configure a server-wide remote query timeout to limit this. Ideally, a database will…
malthe
  • 1,237
  • 13
  • 25
0
votes
2 answers

Azure Synapse Serverles Pool Database Error: Cannot drop database "DataverseEnriched" because it is currently in use

I am attempting to delete/drop a SQL Database created in from Azure Synapse Serverless Built-in Pool, but I keep on getting the error: Error message: 'Failed to execute query. Error: Cannot drop database "" because it is currently in use. '.…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

How to Delete First Row of All Tables in Azure Synapse Serverless Pool

I have create a number of tables in Azure Synapse Analytics and I would like to remove the first row from each of the tables. Can someone assist with code that will remove the first row from each table. I tried the following: DELETE TOP (1) FROM …
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

How to Ensure First Row is Selected when Creating an External Table in Azure Synapse Serverless Pool

I'm able to create an external table in Serverless Pool, but the table won't allow me to select first row. As you can see from the screen shot columns C1, C2, C3, C4, C5 apear in the first row Even though I have specified to use the first row when…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

Unable to Script Table with SSMS version 18.4 on Azure SQL Serverless Pool

I am trying to script a table using SSMS version 18.4 on Azure SQL Serverless Pool as follows: However, I keep on gettinge the following error The full error message is as follows: Invalid version: 16.…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

How to elevate Permissions in Azure Synapse SQL Server

When I attempt to drop an external table in Azure Synapse SQL Pool I get the folloiwng error: Cannot drop the EXTERNAL TABLE 'TableName', because it does not exist or you do not have permission. I am accessing Synapse SQL Server via SSMS. Can…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
1 answer

Create firewalls for Azure Synapse Workspace when Public Network Access is Disabled?

I am trying to provision Synapse Workspace with terraform(with public network access disabled). The synapse workspaces are created and status is succeeded too. Most of the resources are created/provisioned successfully. However, I also would like to…
Tito
  • 87
  • 1
  • 11
0
votes
0 answers

Rethinking Python for loop to pySpark to create dataframes

I have a list of accounts which I iterate in a loop calling the details from an API function get_accounts. The JSON response for each call includes details for one account with one or more contacts which I add to dataframes df_accounts and…
Alen Giliana
  • 2,144
  • 3
  • 17
  • 30
0
votes
1 answer

Azure Synapse Pipeline - Force Sharepoint Excel Data Refresh

I have a Synapse pipeline that pulls an .xlsx file from a Sharepoint folder into our datalake for later ingestion using a copy data activity. It was reported to me that the .xlsx file in Sharepoint is not having data refreshed from its external…
Aarett
  • 1
0
votes
0 answers

Azure Data Studio Authentication Error logging into Synapse Serverless Pool

Am trying to login into Synapse Serverless from Azure Data Studio with Azure Active Directory - Universal with MFA Support, but unable to login throws error on Account selection in browser "Unidentified error with azure authentication" Update:…
Sreedhar
  • 29,307
  • 34
  • 118
  • 188
1 2 3
…
99 100