Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
6
votes
1 answer

Write data to Azure Data Lake Storage Gen 2 using Azure Synapse Analytics notebook

I am connecting to a RESTful api using Azure Synapse Analytics notebook and write the json file to Azure Data Lake Storage Gen 2. pyspark code: import requests response = requests.get('https://api.web.com/v1/data.json') data = response.json() from…
paone
  • 828
  • 8
  • 18
6
votes
2 answers

insert on synapse DW in ssms

simple insert code but i keep getting syntax errors the values lines have a value for each column in the table, it only has 3 columns, i've tried removing the comma, tried using semi colon tried nothing after closing parent, tried explicitly stating…
Madalo Furaha Meredith
  • 93
  • 1
  • 4
6
votes
2 answers

Foreign Key constraints Synapse Azure

Am currently creating a datawarehouse in Azure Synapse, however Synapse does not allow for the creation of foreign keys. This is vital for referential integrity between the fact and dimension table. Does anyone have any suggestions as to what the…
Nayyar
  • 79
  • 1
  • 3
6
votes
2 answers

Azure Analysis Services versus Synapse Analytics

Can someone explain what is the difference between Azure Analysis Services and Azure Synapse Analytics? Why would one use Analysis Services over Synapse Analytics? Thanks,
Raju Joseph
  • 493
  • 1
  • 6
  • 13
6
votes
2 answers

EXTERNAL TABLE access failed due to internal error: 'Java exception raised on call to HdfsBridge_IsDirExist. Java exception message:

I am trying to create external table through polybase with below syntax on Visual Studio 2015. Its giving me the below error. Can some one pls help on this CREATE EXTERNAL TABLE dbo.DimDate2External ( DateId INT NOT NULL, CalendarQuarter…
ravi kiran
  • 371
  • 1
  • 5
  • 17
6
votes
1 answer

Handling embedded new lines when creating/selecting External Tables in SQL Data Warehouse

In SQL Data Warehouse (editors please don't change this, it is the actual name see: here) I have a JobCandidate_ext external table that looks like this. CREATE EXTERNAL TABLE [HumanResources].[JobCandidate_ext]( [JobCandidateID] int, …
santiaago
  • 608
  • 9
  • 19
6
votes
3 answers

Azure SQL Data Warehouse DWU vs Azure SQL DTU

I am considering migration from Azure SQL to Azure SQL Data Warehouse. It seems to offer some of the features that we need, however price is a concern for starting small. 100 DWU Data Warehouse is priced considerably higher ($521/month) than a…
Andrei
  • 1,015
  • 1
  • 11
  • 19
6
votes
3 answers

Azure SQL Data Warehouse ''NoCount' Error

I just got approved for the Azure SQL Data Warehouse Preview, and just finished "provisioning" my new server and database. I followed a link to a 'Getting Started' page from Microsoft (Get started: Connect ...), and read that the two best (only?)…
Daniel A. Burke
  • 544
  • 1
  • 5
  • 11
6
votes
2 answers

Rename Object not supported in Azure SQL Data Warehouse?

I tried to run the following commands in SQL DW: RENAME OBJECT dbo.test TO test2 RENAME OBJECT test TO test2 Both failed with the following error: No item by the name of '[DemoDB].[dbo].[test]' could be found in the current database 'DemoDB',…
Nicolle Anger - MSFT
  • 333
  • 1
  • 3
  • 10
5
votes
1 answer

Conditionally syncing data from one SQL instance to another instance

I have been trying to conditionally/selectively sync millions of records from SQL table on Azure to another SQL database within Azure. Is there any way to configure Azure Data Sync or replication not to sync all records of table, rather sync only…
Abhijeet
  • 13,562
  • 26
  • 94
  • 175
5
votes
0 answers

mssparkutils on local python environment

I'm building some reusable libraries to use in Azure synapse. And these libraries need mssparkutils, built-in synapse library. Is it possible to install this library/module on local python environment?
Venkat
  • 51
  • 2
5
votes
1 answer

OPENJSON collation in Azure Synapse causes a collation conflict error

I have an OPENJSON command that takes the parsed JSON and LEFT joins it onto an existing table. When I add the LEFT JOIN I get the error: collation conflict between "Latin1_General_BIN2" and "SQL_Latin1_General_CP1_CI_AS" The table has the same…
Slicc
  • 3,217
  • 7
  • 35
  • 70
5
votes
2 answers

Error accessing Key Vault while executing Azure Synapse Notebook via Synapse Pipelines

I'm trying to execute an Azure Synapse Notebook using Notebook Activity in Synapse Pipelines and it keeps coming up with errors while debuging the Pipelines, the Notebook is using TokenLibrary.getSecret() and it looks like accessing key vault is the…
Mariusz Repczynski
  • 51
  • 1
  • 2
5
votes
1 answer

List content of a directory in Spark code in Azure Synapse

In Databricks' Scala language, the command dbutils.fs.ls lists the content of a directory. However, I'm working on a notebook in Azure Synapse and it doesn't have dbutils package. What is a Spark command corresponding to dbutils.fs.ls? %%scala …
Summer
  • 363
  • 1
  • 4
  • 15
5
votes
3 answers

Drop Database Error For Azure Synapse Database

When I try to drop a database in my builtin synapse pool, I'm getting the following error: Cannot drop database "database name" because it is currently in use. I've tried in both SSMS and Studio Synapse Studio and both returned errors. I made sure…
ShadowDancerLV
  • 61
  • 1
  • 4
1
2
3
…
99 100