Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
0
votes
1 answer

Azure Synapse - Is there a way to import data from an ODBC source in batches?

We are attempting to import data from Netsuite into Azure Synapse Analytics via SuiteAnalytics Connect (ODBC) - this works on all but one table (transactionLine) where the connection always times out at 2 hours From speaking to Oracle it appears the…
jamiemax
  • 179
  • 13
0
votes
1 answer

Different options to move synapse workspace across different environments

What are the different options to export a workspace let's say from Development into another workspace in TEST, UAT OR Production Synapse Analytics. Most of the options I have come across has been around copying code and pasting it in the intended…
paone
  • 828
  • 8
  • 18
0
votes
2 answers

I need to use the rows of one column to select another column

I have as selection of Columns called Parameter(1 to 10) and I need the row select to join on the column of another table, depending on the Matrix selected. This needs to be driven by the matrix selected. The rows to columns heading is a 1-1…
dszakris
  • 11
  • 2
0
votes
1 answer

Error when creating view on pipeline (problem with BULK path)

Good morning everybody! Me and my team managed to create part of an Azure Synapse pipeline which selects the database and creates a data source named 'files'. Now we want to create a view in the same pipeline using a Script activity. However, this…
0
votes
1 answer

Unable to connect to SQL Server ODBC using python

I am trying to connect to SQL Server from python to read synapse views. I have server name, user name and password. I am using the below code. import pyodbc server = '' database = '' username = '' password = '' cnxn =…
SanjanaSanju
  • 261
  • 2
  • 18
0
votes
0 answers

Spark session is Started but not executing the Next cells in synapse notebook?

I have started the Cluster in azure synapse and the spark session has been started in 2 to 3 minutes but rather than moving to next cell for executing all the cells the execution is still happening in first cell only. what can be the issue which is…
0
votes
1 answer

Variable value in the mail in script in ADF

I have a Adf flow , in which, i have stored the data in a array Variable(namely 'VariOutput'), that thing is present in a If Condition Activity. and in IF condition False Activity , i have given the Web activity link. the code used…
Avenue Guy
  • 27
  • 5
0
votes
1 answer

SQL Server Management Studio 18 - Taking long time to generate script

I have created a table in SQL Server 2014 (v12.0 - dedicated SQL pool) with no partitions using SQL Server Management Studio v16.0. Using an automated script, created right values hourly partitions for 4 months i.e., 2880 partitions. Now I would…
0
votes
1 answer

Azure Data Flows isolate-find substrings form text field

I am trying to isolate several substrings from a specific column of a parquet file that contains text (string). The substrings are all in an array and I want to keep only those rows that contain one or more of these substrings - words, while I keep…
0
votes
0 answers

Incrementally loading into a Synapse table using Spark

I am creating a data warehouse using Azure Data Factory to extract data from a MySQL table and saving it in parquet format in an ADLS Gen 2 filesystem. From there, I use Synapse notebooks to process and load data into destination tables. The initial…
VisibleRound0
  • 26
  • 1
  • 2
0
votes
1 answer

Requiremet of Error logging mail(mail should contain all the missing file details). in the ADF flow

the reqirement is simple , i have a folder having 4 txt files(1.txt,2.txt,3.txt,4.txt) . the Flow is controlled by a parameter called all or some which is of string type. If i select all in the parameter, all 4 file should be processed. the…
Avenue Guy
  • 27
  • 5
0
votes
1 answer

How can I deploy a Synapse Serverless database via an ARM template?

Introduction I'm trying to deploy an ARM template through Azure Pipelines in which a Synapse Workspace is deployed and a Synapse Serverless Database is created thereafter. Please note, this is not a Dedicated SQL Pool, it is a Synapse Serverless…
JMoss84
  • 96
  • 7
0
votes
1 answer

External login created in SQL/ Synapse Analytics but not in server_principals

On the master db of a Serverless Synapse Analytics instance an external login is created for AAD Security Group. CREATE LOGIN [sg-aad-name] FROM EXTERNAL PROVIDER; The login does not show up in the table sys.server_principals. The following query…
Drop17
  • 31
  • 2
0
votes
2 answers

SAP Table Connector - How to querying SAP table using RFC from Azure Synapse

We are using SAP Table Connector on Azure Synapse to extract SAP tables. However, we would like to filter the data in the copy activity. I tried using the RFC table options using the COLUMN EQ 'SOME VALUE' pattern, This worked, but we would like to…
MrKoos
  • 1
  • 1
0
votes
1 answer

connect to azure Synapse via AAD authentication in Tableau

We are trying to connect to Synapse from Tableau via AAD authentication, but getting the following error (screenshot) despite I am the AAD owner and I have the owner permission in database. Is there any configuration we need to do in AAD etc?. any…