Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
4
votes
1 answer

Azure Data Factory Error - String or binary data would be truncated

I'm building my first Data Factory pipeline, a very basic one. I've a Data Flow with just source (csv flatfile) and sink (synapse table). Source has 12 columns. So, I've created a table in Synapse (via SSMS) with all the 12 columns as varchar. No…
LearneR
  • 2,351
  • 3
  • 26
  • 50
4
votes
1 answer

Row-level security based on IS_MEMBER function

Objective I'm implementing row-level security (RLS) at Azure Synapse based on Active Directory (AD) authentication. The idea is that customers added to security_group_A_access have access to all MY_TABLE rows with column CATEGORY = 'A'. See code…
VB_
  • 45,112
  • 42
  • 145
  • 293
4
votes
1 answer

How to update a Azure SQL Database/Data Warehouse table by azure Databricks?

I have a requirement in my project where i am implementing SCD type 2 table in Azure SQL DW. I am able to insert new records using JDBC connector but i need to update old records as "expired" and update other records as per updated values.
4
votes
2 answers

Must declare the scalar variable "@@procid"

I'm pretty new to SQL Server. I'm trying to create a simple procedure to get the name of the current procedure name for debugging purpose. This is the code. -- ====================================================================== -- Create Stored…
BKM
  • 43
  • 6
4
votes
0 answers

Denied Select Permission to Table in Stored Procedure - SQL Server

I created a user testUser and assigned it to newly created role executive. I then created the following procedure: CREATE PROC dbo.spTest AS BEGIN SELECT FirstName, LastName FROM dbo.Emp END And granted the permission to execute that…
4
votes
2 answers

Cannot fetch generated keys through JDBC on SQL Data Warehouse

I have a table like this in my Azure SQL Data Warehouse database: CREATE TABLE t_identity ( id INTEGER IDENTITY (1, 1) NOT NULL, val INTEGER ) Now, using JDBC, I want to insert a row and fetch the generated identity value. This would work in…
Lukas Eder
  • 211,314
  • 129
  • 689
  • 1,509
4
votes
3 answers

Azure SQL DW to Azure SQL DW using Polybase

I know you can use polybase using external table to load large volume of data from Blob Storage to Azure SQL DW. But is there any possibility that we can import the data from SQL DW to another SQL DW using polybase directly? Or is there some other…
HimalayanNinja
  • 421
  • 3
  • 11
4
votes
1 answer

Stored Procedure result into temp table in Azure Data Warehouse

In Azure Data Warehouse, i have a Stored Procedure which will return the result of SELECT command. How to push the Stored Procedure result into temp table? I tried the below query and it is returning an error message. CREATE TABLE #temp (name…
Suresh
  • 93
  • 2
  • 7
4
votes
2 answers

Could not allocate a new page for database ‘TEMPDB’ because of insufficient disk space in filegroup ‘DEFAULT’

ETL developer reports they have been trying to run our weekly and daily processes on ADW consistently. While for the most part they are executing without exception, I am now getting this error: “Could not allocate a new page for database ‘TEMPDB’…
Steve
  • 548
  • 8
  • 24
4
votes
3 answers

Azure SQL DW data loads taking long time

I am trying to load the data from my External Tables to SQL DW Internal tables. I have the data stores in a compressed format in BLOB Storage and External tables are pointed to the BLOB Storage Location. I have around 24 files, which is around 22GB…
Aravind
  • 179
  • 1
  • 2
  • 14
4
votes
2 answers

Azure Data Warehouse PolyBase File format

We have a file that looks like this: Col1,Col2,Col3,Col4,Col5 "Hello,",I,",am",some,data! It therefore has the following 'properties': Comma-separated Double-quote column delimiter Commas in some of the columns Now, I am not sure if it's actually…
m1nkeh
  • 1,337
  • 23
  • 45
4
votes
3 answers

Time-based drilldowns in Power BI powered by Azure Data Warehouse

I have designed a simple Azure Data Warehouse where I want to track stock of my products on periodic basis. Moreover I want to have an ability to see that data grouped by month, weeks, days and hours with ability to drill down from top to bottom. I…
Mando
  • 11,414
  • 17
  • 86
  • 167
4
votes
1 answer

Azure SQL Data Warehouse bandwidth limits?

Are there any bandwidth limits or throttling for Azure SQL Data Warehouse extracts? Are there any connection string settings that optimize how fast we can extract data via a SELECT query? From SSIS on a VM in the same Azure region as SQL DW, if I…
GregGalloway
  • 11,355
  • 3
  • 16
  • 47
4
votes
1 answer

BroadcastMove in Azure SQL DW

Because Azure SQL DW doesn't currently have replicated tables (update: it does now), what exactly happens during a BroadcastMove? Does one temp table per compute node get created and populated with the results of broadcast? Then do 60 queries (one…
GregGalloway
  • 11,355
  • 3
  • 16
  • 47
4
votes
1 answer

How does Azure SQL DW know the row count without statistics?

If I run a CREATE EXTERNAL TABLE cetasTable AS SELECT command then run: EXPLAIN select * from cetasTable I see in the distributed query plan:
GregGalloway
  • 11,355
  • 3
  • 16
  • 47