Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
0
votes
1 answer

Load sql script in PySpark notebook

In Azure Synapse Analytics, I want to keep my SQL queries separately from my PySpark notebook. So I have created some SQL scripts. And I would like to use them in my PySpark notebook. Is it possible ? And what is the python code to load a SQL…
Sybaris
  • 41
  • 5
0
votes
1 answer

Microsoft.Synapse/workspaces/sqlPools/read Error

I am following this document https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/how-to-pause-resume-pipelines to get the list of SQL pools, but facing the error: The client 'XXXXX' with object id 'XXXXXX' does not have authorization to…
Saxia
  • 15
  • 4
0
votes
1 answer

Failed to list resources error, when adding a new user to Azure Synapse Analytics Workspace

I am trying to add users to my synapse workspace and getting a 'Failed to list resources' error. I have 'Synapse Administrator' role privileges. Please help.
dikokob
  • 85
  • 3
  • 12
0
votes
1 answer

Azure Apache Synapse Spark Pool Display Function Issue

When I run the display function with Databricks I get the option to download the results as CSV. I am tring to do the same with Azure Synapse Spark Pools, however I getting the…
Patterson
  • 1,927
  • 1
  • 19
  • 56
0
votes
0 answers

Azure synapse Analytics connection to MongoDB Atlas

I'm new to Azure synapse Analytics. I'm trying to copy data from my mongodb Atlas cluster to a datalake I'm trying to use a private endpoint to authorize the connection from my Azure Synapse workspace, but I always get a timeout issue every time I…
Mariano GBEGO
  • 1
  • 1
0
votes
1 answer

Can you create a Parquet file using the Serverless Pool?

We have been using Synapse for some time and are primarily using the Serverless Pool with Parquet, External Tables, and Views. I have a few large views that read multiple external tables and take a long time to generate. I am hoping I might be…
Matt
  • 53
  • 1
  • 5
0
votes
1 answer

Create template files for specific branch in Synapse

I need to create a custom parameters file for the Synapse template export. However I don't want to merge the file to the collaboration branch until I know it works as expected. Is there a way to create the template files locally using Azure CLI or…
Alex AIT
  • 17,361
  • 3
  • 36
  • 73
0
votes
0 answers

Are the contents of the Synapse publish branch merged to main?

By default, Synapse creates a new branch called workspace_publish when publish is executed via the UI. This has two things I am uncertain about: The branch has no relation to or files from the collaboration branch (main) The branch contains only a…
Alex AIT
  • 17,361
  • 3
  • 36
  • 73
0
votes
1 answer

Azure synapse apache spark pool can't install geopandas due to recent update

We follow this steps for package management for apache spark pool in our synapse environment: https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-manage-pool-packages#yml-format Due to recent update for conda environment on…
Kamil Banaszczyk
  • 1,133
  • 1
  • 6
  • 23
0
votes
0 answers

How to bulk load JSON with values into Synapse SQL dedicated pool

I'm attempting to bulk load json files, along with their filenames and paths into a synapse analytics dedicated sql table but I'm just stumped on how to accomplish it. I can load the json files solo without a problem, but I really need the…
brad
  • 605
  • 2
  • 7
  • 18
0
votes
1 answer

Azure Data Factory Dataflow with Azure Synapse Link to Remove Duplicate Records

I am using Azure Synapse Link to connect Azure storage to load the RAW to from CRM. there is option which i choose Append mode only. it is creating a duplicate records if anything changes happen from CRM tables(modules). in that case, how do we…
Developer KE
  • 71
  • 1
  • 2
  • 14
0
votes
1 answer

Executing DMV's on Power BI models or Tabular model in Azure Synapse notebooks or ADF

Is there a way in which we can connect to Power BI dataset in Azure Synapse notebook or Azure Data Factory and execute DMV's, say for example like below: select * from $System.TMSCHEMA_MEASURES
Joseph
  • 530
  • 3
  • 15
  • 37
0
votes
1 answer

Azure Synapse query optimization: Join of 3 huge tables

One of the SP involving the join of 3 tables and then putting it into a new table is taking forever to process. Table1 has 86,12,44,940 records (84gb). Table2 has 72,98,41,882 records. (56gb) Table 3 has 46140 records. Any idea how can I process…
Siddcity
  • 53
  • 5
0
votes
1 answer

Getting data from REST API in Synapse with pagination rules giving invalid JSON structure

I'm getting data from SAP Success Factors using the REST API in Azure Synapse Analytics with Copy data activity. Below the structure of the body returned by the REST api: { "d": { "results": [ { "object1":…
Valouf
  • 55
  • 1
  • 6
0
votes
0 answers

Azure Synapse Spark Pool not working properly for simple tasks

I am currently having issues with my Apache Spark Pool in Azure Synapse Analytics using python: A rather trivial task of displaying a pandas dataframe of 200k rows is not possible, but merging on 1.7 million rows and grouping is possible. This…
Tossibob
  • 31
  • 4
1 2 3
…
99
100