Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
3
votes
1 answer

Simple Performance Test on Azure SQL Data Warehouse

We are working to port existing applications to Azure SQL Data Warehouse. In order to better understand the performance/workload management characteristics/capabilities of Azure SQL Data Warehouse, I have set up what I consider a very simple…
Steve
  • 548
  • 8
  • 24
3
votes
1 answer

SQLException while connecting to Azure SQL Data Warehouse using JDBC

I am trying to connect to Azure SQL Data Warehouse through JDBC. I am getting the following exception. * com.microsoft.sqlserver.jdbc.SQLServerException: The TCP/IP connection to the host tcsqldatawh.database.windows.net, port 1433 has failed.…
3
votes
1 answer

Azure SQL Data Warehouse: No catalog entry found for partition ID in database . The metadata is inconsistent. Run DBCC CHECKDB

I am working on moving stored procedures from an on-prem SQL Server database to an Azure SQL Data Warehouse (ASDW). Throughout the process I have had to work around a few missing features - time consuming but not impossible. One thing I have had…
How 'bout a Fresca
  • 2,267
  • 1
  • 15
  • 26
3
votes
2 answers

How to load to Azure SQL Data Warehouse data stored as JSON in Azure Blobs?

I have a bunch of data stored as JSON file in Azure Blobs. I want to load them into Azure SQL Data Warehouse, but Azure SQL Data Warehouse does not seem to accept JSON input files. What is the best approach? Solutions I looked into: 1) Using Azure…
shadow me
  • 43
  • 1
  • 5
3
votes
1 answer

Azure SQL Data Warehouse - Slow LEFT JOIN with temporary table

I run a very simple Query (see below) in my "Azure SQL Data Warehouse" and it takes 5 seconds. If I run the same Query in "Azure SQL Server" it takes 0 seconds which seems more normal. (This Query is basically a bunch of LEFT JOINS without condition…
Lars
  • 71
  • 4
3
votes
1 answer

Issue connecting to Azure SQL Data Warehouse

I'm having an issue connecting to an Azure SQL Data Warehouse instance from within a corporate firewall. I can connect to the server itself (i.e. the master database), and can telnet to both the server name and IP on 1433, but when I attempt to…
3
votes
1 answer

Unable to create EXTERNAL TABLE to Azure SQL Server on Azure SQL Data Warehouse

Unable to create EXTERNAL TABLE at Azure SQL Data Warehouse pointing to Azure SQL Server. CREATE EXTERNAL DATA SOURCE EX_SOURCE WITH ( TYPE = RDBMS, LOCATION = 'SERVER.database.windows.net', DATABASE_NAME = 'DB_NAME', CREDENTIAL =…
3
votes
1 answer

Escaping quotes in Polybase with STRING_DELIMITER

I've got a pipe delimited flat file I want to load with Polybase. String columns are quoted with double quotes and if there are double quotes in the value, they are doubled. I believe that's a valid file format: SizeDescription|SizeCode "3.5…
GregGalloway
  • 11,355
  • 3
  • 16
  • 47
3
votes
2 answers

Polybase - maximum reject threshold (0 rows) was reached while reading from an external source: 1 rows rejected out of total 1 rows processed

[Question from customer] I have following data in a text file. Delimited by | A | null , ZZ C | D When I run this query using HDInsight: CREATE EXTERNAL TABLE myfiledata( col1 string, col2 string ) row format delimited fields terminated by '|'…
3
votes
2 answers

scheduled 1:1 copy of tables between Azure SQL databases using Data Factory without specifying table schema

Using Azure Data Factory, is it possible to perform a scheduled 1:1 copy/clone of all rows from multiple (not all) tables residing in an Azure SQL DB to another Azure SQL DB (in this case an Azure SQL Data Warehouse), without having to explicitly…
3
votes
3 answers

Join Considerations in Azure SQL Data Warehouse

How should you design your Fact and Dimension tables too speed up joins on the new Azure SQL Data Warehouse? Would distributing the large fact tables by hash and replicating the smaller dimension tables help speed up the join or should indexing be…
2
votes
1 answer

How to clone a SQL database in Azure Synapse - no menu option, despite being Synapse Administrator

I'm trying to clone a Synapse Serverless SQL database, so I can test with it. When I click a SQL database in Synapse Studio, there's no option to clone. No 'Clone' option in menu I am the Synapse Administrator - Blacked out personal details - it's…
Pingyao
  • 23
  • 5
2
votes
1 answer

PySpark with SynapseSQL throws error when using queries with restricted keywords in column name

I'm quering SQL Database on Azure Synapse Analytics server with PySpark. However, some of my column names may contain restricted keyword(s). Here, I've prepared a generic example which I could bypass with changing the name of c.Name as something…
2
votes
1 answer

Azure Synapse Dedicated SQL POOL - Query Log

I am bit new to Azure synapse dedicated SQL POOL ,I am trying to find List of SQL queries executed by users on Dedicated SQL POOL in Last seven days with user name. I have tried using DMV sys.dm_pdw_exec_requests & sys.dm_pdw_exec_sessions but not…
2
votes
0 answers

Removing spark.autotune.trackingId change in every notebook PR with Azure Synapse

I am working with a git integrated Azure Synapse workspace. Currently on every PR, we are seeing changes to the spark.autotune.trackingId config within each modified notebook. I have tried googling about this, and have struggled to find much detail…
Liam Ferris
  • 1,786
  • 2
  • 18
  • 38