Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
0
votes
1 answer

Can't read REST API with an XML response using Synapse Pipeline's Copy Activity

Trying to read REST API endpoints through Synapse pipeline and sinking it in a JSON format. The API response is XML and the run ends up erroring out. --------Error--------- { "errorCode": "2200", "message": "Failure happened on 'Source' side.…
Morpheus273
  • 37
  • 1
  • 6
0
votes
0 answers

How to manage triggers in a synapse workspace for each environment

I'm working on importing a repository from Git repository and creating its own branch per environment (DEV,Test,PreProd,Production) when I import the repository I import triggers too, but, looks like they only run off of the live mode but not…
paone
  • 828
  • 8
  • 18
0
votes
1 answer

Import a notebook into another book in Azure Synapse

I have one notebook1 in synapse ws with python code that contains some variable. I have created another notebook2 and I'd like to use the variables from notebook1. I tried to import as a package, but it didn't work. Has any one done that in the…
tarik bouchnayf
  • 1
  • 2
0
votes
1 answer

Authenticating with a Cookie in ADF

I've got an web address with a URL authentication token in the first activity. In the second call I can't authenticate with this token anymore, but based on the cookie that I got from the first call I have access to the data that I need. So in my…
AntonyJ
  • 29
  • 6
0
votes
1 answer

Allow User to Extract Data Dumps From DW

We use synapse in azure as our warehouse and create reports in power bi for our users on top of this. We currently have a request to move all of the data dumps from our production system onto our warehouse DB as some of them are causing performance…
Glyn Thomas
  • 15
  • 2
0
votes
1 answer

Script to Shutdown/Startup Synapses

I'm pretty new to Synapse but we are looking for a script to shutdown/startup Synapse during non business hours. This is to help reduce our costs during evenings and weekends. Any assistance would be appreciated. Is anyone aware of a script that…
Dave
  • 1
0
votes
1 answer

How to write Execute AS Script in Stored Procedure in Azure Synapse Dedicated Pool?

I am trying to create a Stored Procedure in Azure Synapse Dedicated Pool, but I am facing an error. I don't know much about Transact-SQL and Synapse limitations, so I am unable to debug the real issue here. This Stored Procedure is part of…
Av1n4sh
  • 72
  • 1
  • 8
0
votes
1 answer

Azure Synapse: Show where Integration Pipeline is called

I have a huge Azure Synapse project with visual integration pipelines. How can I see in which other pipelines a selected pipeline is called/triggered - how can I find the callers?
user3579222
  • 1,103
  • 11
  • 28
0
votes
1 answer

Synapse pipeline import resource from git

I have a situation here where I import resources from my Azure DevOps Git repository DEV to TEST, I want DEV code to be independent of TEST and not commit my changes back to the repository. After I import the repository to TEST I made changes to…
paone
  • 828
  • 8
  • 18
0
votes
2 answers

Azure Synapse Copy Activity error: CREATE TABLE dbo is not supported

I am having trouble using the Table Option named Auto Create Table on a Copy Data activity. The source I use is a REST API which can be requested correctly, and actually data can be previewed normally. However, even though I count with every…
Mateo Estrada
  • 15
  • 3
0
votes
1 answer

No FileSystem for scheme "az" error when trying to read csv from ADLS Gen2 using PySpark

import pandas as pd import pyspark.pandas as ps I am trying to use the pyspark pandas api to compare performance between two similar scripts (one using pandas and one using pyspark through the pandas interface). However, I have trouble importing my…
RogerKint
  • 454
  • 5
  • 13
0
votes
1 answer

How to build OR-behavior into Azure Synapse pipelines?

I have a pipeline in Synapse that reloads data from a number of REST-endpoints. It looks as follows: What I want to achieve is that the 'CheckAccessTokenValidity' activity checks whether my API-token is still valid. If yes, all is fine, proceed to…
Psychotechnopath
  • 2,471
  • 5
  • 26
  • 47
0
votes
1 answer

How can I pull a table's column list via GridConfiguration similar to how it's done in regular SQL?

I encountered an SQL query structured this way. The code snippet was given to me without explanation so I'm at a loss on where to proceed. The query works but I would like to expand on it. (Also, probably the wrong flair but this is being run on a…
Milo Ulver
  • 51
  • 7
0
votes
1 answer

How to set parquet column name dynamically

I want to merge multiple csv files in Azure Synapse Pipeline. And I'll realize it with copy activity, but I am facing with a problem. There are two types of source files. The one has the header(file type is 'with header') and other doesn't have the…
Straitsuo
  • 1
  • 1
0
votes
1 answer

sqlcmd login to synapse - not workng

I wanted to try to connect to azure synapse from the terminal using sqlcmd which is not happening from my machine. I did tried this way: Even all the input is given but still sqlcmd is throwing one syntax error. Please correct me where I need to…
Indrajeet Gour
  • 4,020
  • 5
  • 43
  • 70
1 2 3
…
99 100