Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
4
votes
1 answer

Type of Databases on Azure SQL Data Warehouse

Is there a way to look at catalog data to determine if the database is an Azure SQL Data Warehouse Database? For example, I have an initial database I've created via Azure, however I've found I can create another database in this Azure SQL Data…
Todd Wilson
  • 78
  • 4
4
votes
1 answer

Real-time data synchronization from Azure database to Azure SQL Data Warehouse?

I've done a fair bit of reading and it seems like there are a couple of off-the-shelf products that replicate/sync data from on-premise database to Azure SQL Data Warehouse but I've found nothing that syncs using an Azure database as the source. …
Sean
  • 43
  • 3
3
votes
1 answer

Azure Synapse: Can I import modules from other notebooks in the same worksapce?

In normal Python project we might have a parent py file that imports from a sibling or child folder/module (initialised by __init__.py, from .folder import module etc. Is there a way to do this using Synapse notebooks within a given (ex. dev)…
Paul Wilson
  • 562
  • 5
  • 16
3
votes
2 answers

Dedicated SQL Pool, cannot insert NULL

I have one table in SQL Server on premise that I wanted to migrate to Azure Dedicated SQL Pool. CREATE TABLE test1 ( col1 INT PRIMARY KEY, col2 INT NULL ); CREATE TABLE test2_dedicated_pool ( col1 INT NOT NULL, col2 INT NULL ) WITH…
xmlapi
  • 61
  • 1
3
votes
1 answer

Can i run stored procedure in spark pool synapse?

I wanted to know how we can run stored procedure in spark pool (azure synapse) which i have created in dedicated SQL pool. Also can we run SQL queries to access data in ddsql pool in notebook.
darkstar
  • 39
  • 6
3
votes
2 answers

Find All the tables related to a stored procedure in Azure Synapse Datawarehouse

Is there a simple way to find out all the tables referenced in a stored procedure in azure analytics data warehouse other than parsing the stored procedure code? I tried few commands like sp_tables, sp_depends but none seems to be working in azure…
bmsqldev
  • 2,627
  • 10
  • 31
  • 65
3
votes
1 answer

COPY INTO fails when one of the csv columns has quotes as part of the data

I have a CSV file with a column contains " as part of the data The file is initially copied in ASF from SFTP location to ADLS in the copy activity I tried adding quotes as the Quote character so my data looks like (this is just an example, the…
AviR
  • 31
  • 2
3
votes
3 answers

PySpark switching between Synapse Linked Services

I have two linked services for two AzureDataLakeStorage-Gen2 set up in my Synapse workspace: one_linked_service_name two_linked_service_name I need to copy data (and do transformations) from one ADLS to the other ADLS. I have a list of…
Cribber
  • 2,513
  • 2
  • 21
  • 60
3
votes
1 answer

DBT - use DBT modeling to insert rows in a table like date dimension table in Azure Synapse

I need reference to inserting rows in a table using DBT models. Sample example that can be considered is a date dimension table, where we want to insert rows for next years.
user961
  • 453
  • 6
  • 20
3
votes
1 answer

Azure Synapse - Query JSON using OPENROWSET - FIELDTERMINATOR Value 0x0b

In Azure Synapse Serverless SQL Pool, while reading JSON documents using OPENROWSET via the CSV parser, we are having to specify the FIELDTERMINATOR and FIELDQUOTE as '0x0b' (vertical tab). Can someone help understand the reason why please? If it's…
Ramesh
  • 1,405
  • 10
  • 19
3
votes
0 answers

Is there a monitoring endpoint for Spark Structured streaming?

In Spark's official docs, we see that there are monitoring endpoints for DStream like /streaming/statistics However, there does not seem to be ones for structured streaming mentioned here. I'm looking to monitor streaming…
yeskarthik
  • 60
  • 5
3
votes
1 answer

Azure Synapse Apache Spark : Pipeline level spark configuration

Trying to configure spark for the entire azure synapse pipeline, Found Spark session config magic command and How to set Spark / Pyspark custom configs in Synapse Workspace spark pool . %%configure magic command works fine for a single notebook.…
tchelidze
  • 8,050
  • 1
  • 29
  • 49
3
votes
1 answer

Azure Synapse development (code writing) best practice

our group is starting to work on Azure Synapse for our data analytics and we've seen the integrated notebooks and sql. however, these are very minimal and might be good place to start, but soon enough we'll want to move the work to some IDE like…
No Idea For Name
  • 11,411
  • 10
  • 42
  • 70
3
votes
3 answers

Azure Synapse Workspace: Where the scripts are published?

In an Azure Synapse workspace, there are two options (shown in red below) for publishing your content. Question: Where the content/scripts are published, and how can we access them after publishing?
nam
  • 21,967
  • 37
  • 158
  • 332
3
votes
2 answers

can't load parquet timestamp using Synapse serverless pool's OPENROWSET

TL;DR The first possible parquet timestamp, 0001-01-01 00:00:00.000 cannot be loaded with Azure Synapse Serverless SQL Pools, as DATETIME2 or any other type. I'm baffled bc the DATETIME2 docs say that this is within the acceptable…
Anders Swanson
  • 3,637
  • 1
  • 18
  • 43
1 2 3
…
99 100