Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
0
votes
0 answers

how to schedule different tumbling window trigger times in dev and prod environments

We have azure synapse studios in dev and prod environments and for one of the pipelines we have a tumbling window trigger setup. We also have Azure Devops release pipelines setup to release the Synapse workspace from Dev to Prod. For this tumbling…
rajani
  • 11
  • 1
0
votes
1 answer

403 Forbidden when accessing Storage Account through firewall from Azure Synapse's dedicated SQL pool

Getting a 403 Forbidden when trying to access a firewall'd Storage Account from a dedicated SQL pool in Azure Synapse. It works when I disable the Storage Account firewall. Relevant configuration: Vnet: 10.0.0.0/16 with a Snet of…
dh762
  • 2,259
  • 4
  • 25
  • 44
0
votes
1 answer

Azure Synapse - Import python scripts in notebooks

Am using Azure Synapse in combination with jupyter notebooks: Many of my jupyter notebooks import some custom python scripts like the util-import: However, there's no option hold *.py files in Azure Synapse. Always when i use the import…
R. Maier
  • 340
  • 2
  • 13
0
votes
1 answer

How to handle Null or Blank in a filter activity logic expressions

I am trying to filter out the null record from previous lookup activity in azure synapse workspace. To do this, I have used the below mentioned expressions in filter activity. But I am not able to get rid of the null records in the filter activity…
sac
  • 175
  • 2
  • 14
0
votes
0 answers

Create view which will do partition filtering in Synapse openrowset

I have a view that is defined as create view [dbo].[darts] as SELECT pricedate, [hour], node_id, dalmp, cast(result.filepath(1) as int) as [Year], cast(result.filepath(2) as int) as [Month] FROM OPENROWSET( BULK…
Dean MacGregor
  • 11,847
  • 9
  • 34
  • 72
0
votes
1 answer

Getting Azure Synapse pipeline run ID when running noteboot

How can I get Azure Synapse Pipeline run ID using python SDK in a synapse notebook? I have a ML pipeline that do a batch prediction everyday. What I want to do is get the pipeline run ID to save inside a DataFrame that is created in one of the…
Gabriel Padilha
  • 121
  • 8
0
votes
1 answer

How to load a spark dataframe data into synapse Dedicated pool in Synapse?

I have a dataframe having 100000 records that we have got after doing transformations, now i have to load all this data into synapse dedicated Pool in COUNTRY_TABLE. How can I achieve this in Synapse? Few Other Queries Is it Compulsory to create a…
BigData Lover
  • 135
  • 8
0
votes
0 answers

Issue in running SQL Server Stored Proc using pyodbc

I am trying to run an Stored Proc in SQL Server (Synapse) using pyodbc.This SP merely performs INSERT operation into a table. sql =""" EXEC my_sp (?,?,?)""" values = (str(v1),str(v2),int(v3)) cur.execute(sql,(values)) conn.commit() This above code…
pythondumb
  • 1,187
  • 1
  • 15
  • 30
0
votes
1 answer

How can we query Azure Synapse table from Azure Logic App

How can we query azure synapse table from azure logic apps.To fetch all the rows
Akram
  • 958
  • 5
  • 11
0
votes
0 answers

Azure Databricks Delta table Access through API

There is a requirement to expose data present in Azure Databricks delta tables through Rest API. These API will be used by both internal & external users. Query: What are the best possible option available to expose delta table data through Rest API…
user1941025
  • 541
  • 6
  • 21
0
votes
0 answers

How to check or see size of cosmos DB document or is there any limit on loading of Azure DWH from cosmos DB

when I am trying to insert the data from cosmos to Azure DWH , it is inserting well for most of the databases but for some it is giving some strange issues. Later we found out that it is due to the size of the Cosmos DB document. Like we have 75GB…
Shailendra Kad
  • 31
  • 1
  • 9
0
votes
1 answer

CETAS TSQL query is not generating csv files with headers

I am writing a CETAS(create external table as select) query in TSQL using synapse. As all these CETAS queries generate a .csv file in a location (in storage account/data lake gen2), none of these files have headers. Is there a possible solution or…
Kapil Shukla
  • 179
  • 1
  • 10
0
votes
1 answer

Azure Synapse Data Flows - parquet file names not working

I have created a data flow within Azure synapse to: take data from a dedicated SQL pool perform some transformations send the resulting output to parquet files I am then creating a View based on the resulting parquet file using OPENROWSET to allow…
jamiemax
  • 179
  • 13
0
votes
1 answer

How to download files from SFTP that doesn't have actural files in Synapse?

I have a little bit complicate situation here: I need to download files from a SFTP daily. I connect to the SFTP with username and SSH key, the keys have a passphrase. This SFTP has no actual files. All the files on the server is 0 bytes. The server…
Jing
  • 13
  • 4
0
votes
0 answers

read keyvault secret from Synapse notebook

I am trying to read keyvault secret from Synapse notebook using: s = TokenLibrary.getSecret(kv, secret_name) It works when I am running it in debug mode, but fails when it is scheduled. I granted Synapse server managed identity Get and List secret…
DejanS
  • 96
  • 9
1 2 3
…
99 100