Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
4
votes
2 answers

Where is data physically stored in Azure Synapse Dedicated SQL Pool?

Documentation from Microsoft and others strongly emphasizes the separation between storage and compute in Azure Synapse Analytics. In the case of a Serverless SQL pool, it is clearly explained that the data is stored in an Azure Data Lake DSL…
ELFIGHA
  • 41
  • 4
4
votes
0 answers

How do I save a file using Pyplot within Azure Synapse Workspace?

I am utilizing an Azure Synapse Analytics Workspace where I am running a PYSpark notebook from the Notebook tab of the workspace. The workspace is also connected to an Azure Data Lake Storage Gen 2, which has a container called filesystem. Usually…
Darren Teo
  • 41
  • 1
4
votes
1 answer

can we execute sql query in serverless pool from pipeline azure synapse?

Can we execute SQL query in the serverless pool from the pipeline in Azure Synapse? We are trying to run the SQL query in the Synapse pipeline, we are not able to find a way to execute the same from the pipeline using the serverless pool.
4
votes
1 answer

Unable to Query Serverless Pool View in Azure Synapse using SQL Admin Credentials

I have set up a Serverless SQL pool in Azure Synapse that is querying a view I had set up of a linked Azure Data Lake. CREATE VIEW DeviceTelemetryView AS SELECT corporationid, deviceid, version, Convert(datetime, dateTimestamp, 126) AS…
4
votes
3 answers

How to retrieve View definition on Synapse (Azure SQL DW)?

I am new to Synapse (Azure SQL DW). Currently, the DW has lots of views and I need to modify a handful of them. The issue is that I do not know how the views were created. Is there a query to check the view definition in Synapse or more…
Ken Masters
  • 239
  • 2
  • 17
4
votes
1 answer

How to append the dataframe data into dedicated SQL pool through Spark pool of synapse?

How to append the data frame data into dedicated SQL pool through Spark pool of synapse?
4
votes
6 answers

Access issue with Azure Synapse studio

I created a Synapse workspace in my Azure Portal and tried opening the Synapse studio and I received the following error: Failed to load one or more resources due to No access, error code 403. credential linkedService dataset pipeline…
ZZZSharePoint
  • 1,163
  • 1
  • 19
  • 54
4
votes
3 answers

Synapse Notebook reference - Call Synapse notebook from another with parameters

I have a synapse notebook with parameters .I am trying to call that notebook from another notebook. I am using %run command. How should I pass the parameters from the base notebook to the one that is being called?
4
votes
1 answer

Why this T-SQL query doesn't work in Synapse?

I am testing Synapse. I tried this query SELECT TOP 100 * FROM OPENROWSET( BULK '', FORMAT='PARQUET' ) AS [result] But I get the following error. How can I solve it? Parse error at line: 4,…
MetallicPriest
  • 29,191
  • 52
  • 200
  • 356
4
votes
1 answer

Can I backup Serverless SQL pool Database?

Synapse Analytics serverless SQL pool endpoint can have multiple databases. Serverless SQL pool has no local storage; only metadata objects are stored in databases. Question: Can I backup these databases manually? I don't see anything in the…
SqlWorldWide
  • 329
  • 4
  • 20
4
votes
1 answer

Working with pyspark in Azure Synapse Analytics how do I create a session that multiple notebooks can use

I'm creating a data pipeline in Azure Synapse. Basic flow: grab some CSV files of 837 EDI data. Put those data files on Azure Data Lake (Gen2). Foreach file put data into tabular database table format in Spark DB, named claims. See my flow my…
Le Poissons
  • 39
  • 1
  • 4
4
votes
2 answers

Running nltk.download in Azure Synapse notebook ValueError: I/O operation on closed file

I'm experimenting with NLTK in an Azure Synapse notebook. When I try and run nltk.download('stopwords') I get the following error: ValueError: I/O operation on closed file Traceback (most recent call last): File…
User181
  • 111
  • 8
4
votes
1 answer

Join data in Azure Synapse from dedicated sql pool and serverless sql pool

I have defined a view in an AzureSynapse serverless pool that fetches data with openrowset. I also have data in a table in a dedicated sql pool. Can I do a sql query that would join these two tables?
Mathias Rönnlund
  • 4,078
  • 7
  • 43
  • 96
4
votes
5 answers

Using Delta Tables in Azure Synapse Dedicated/Serverless SQL Pools

I am currently employed as a Junior Data Developer and recently saw a post saying that Azure Synapse can now create SQL tables from Delta tables. I tried creating an SQL table from a Delta table which is inside a Delta lake Storage V2, but the table…
Kieran Goodlip
  • 41
  • 1
  • 1
  • 3
4
votes
3 answers

Tasks - Generate Scripts in Azure Synapse Serverless SQL

I am working with an Azure Synapse Serverless SQL instance, connected via the most recent version of SSMS. I have several external tables defined over parquet files in an Azure Data Lake (Gen2). My question is how do I use the typical…
user24536
  • 57
  • 1
  • 6