Stack Overflow
Stack Overflow

Questions tagged [sql-data-warehouse]

108 questions
1
vote
2 answers

Azure DataWarehouse load CSV with external Table

I can't find a complete example on how I would be able to load a CSV file directlry with a external table into a Sql Datawarehouse. The file is on a Storage account https://tstodummy.blob.core.windows.net/ Blob container referencedata-in, folder…
Harry Leboeuf
  • 723
  • 12
  • 30
1
vote
1 answer

Visual Studio Deploy to SQL Data Warehouse Incorrect Syntax Near 'ANSI_NULLS'

I would like to deploy a Database Project in Visual Studio 2017 to Azure SQL Data Warehouse. Unfortunately each attempt fails with the following error message Failed to import target model [database name]. Detailed message Parse Error at line: 1,…
lennard
  • 11
  • 3
1
vote
1 answer

Error while using the write method of a dataframe object on databricks

I am trying to write some data to Azure SQL Data Warehouse using Azure Databricks and Python. The code I am using is as follows: salesdf.write\ .format('com.databricks.spark.sqldw')\ .option('url', sqlDwUrlSmall)\ .option('dbtable',…
Brian Custer
  • 35
  • 8
1
vote
2 answers

Loading data from oracle to SQL in multiple tables simultaneously using SSIS

enter image description here I am creating a clinical data warehouse, so I am testing different scenarios. I am loading the below tables from oracle DB (Attunity connector) to SQL DB (OLE DB): Table1 1.2 GB(3 million rows) Table2 20 GB(200 million…
Doodle
  • 481
  • 2
  • 7
  • 20
1
vote
1 answer

Loading only latest files data to Azure SQL Datawarehouse

Step#1: WE are supposed to copy the CSV Files from On-Premise File Server to Azure Blob Storage (say - 'Staging' Container in Blob Storage). Step#2: Applying Polybase, we will load these files data to Azure SQL Datawarehouse. We are maintaining the…
Koushik
  • 11
  • 3
1
vote
1 answer

Bulk data processing using dapper and data warehouse

I am using dapper in front end to process the data and inserting it into data warehouse. I have a scenario where i need to send bulk data from from dapper to data warehouse and perform few operation on it. I can do that using data table. i can…
Jai
  • 416
  • 6
  • 20
1
vote
2 answers

JOOQ with SQL DataWarehouse?

Does JOOQ support dialect for "SQL DataWarehouse"? Any pointers .
Sid
  • 11
  • 2
1
vote
2 answers

DB Driver for azure SQL Data ware house via python notebook in ML Studio

I am trying to access my data warehouse azure, fetch some data in mlstudio-attached-notebook in python. Simple connection says driver not found. [01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 13 for SQL Server' : file not found (0)…
moeen-ud-Din
  • 160
  • 1
  • 13
1
vote
1 answer

Debug sql database scoped credentials failure

I created a scoped credential in a Azure SQL Datawarehouse database to create an external table over some files in a Azure Data Lake Store. When I try creating the external table I get the message. Msg 105061, Level 16, State 1, Line 35 Unable to…
Molotch
  • 365
  • 7
  • 20
1
vote
1 answer

How to parse a JSON formatted string in Azure SQL Data Warehouse?

T-SQL has a couple of functions that can parse JSON data, but none of them are applicable to Azure SQL Data Warehouse. I have data in JSON format in a VARCHAR column that looks like: {'Purpose': 'Purpose 1', 'Activity': 'This activity'} I could…
Erik Shilts
  • 4,389
  • 2
  • 26
  • 51
1
vote
3 answers

Convert timezone in Azure SQL Data Warehouse

I have a DATETIME column from the US/Pacific timezone, but it is not encoded as such. How can I convert this to UTC timezone in Azure SQL Data Warehouse? The AT DATETIME T-SQL function seems like the closest fit, but it is not supported by Azure SQL…
Erik Shilts
  • 4,389
  • 2
  • 26
  • 51
1
vote
1 answer

Cast binary column to string in Azure SQL Data Warehouse

I currently have functions in Postgres and Redshift that take a randomly generated string, hash it, then uses part of the hash to generate a random number between 0-99. I am trying to replicate this functionality in Azure SQL Data Warehouse such…
Erik Shilts
  • 4,389
  • 2
  • 26
  • 51
1
vote
0 answers

Invoke Batch file using Azure Data Warehouse

I am trying to run EXEC master..xp_CMDShell 'c:\test.bat' in SQL Azure Data Warehouse but I found out that xp_CMDShell is not supported in Azure, can you help with an alternative to invoke an exe from Azure Data warehouse? Within the batch file I…
Joseph
  • 530
  • 3
  • 15
  • 37
1
vote
1 answer

Azure Data Warehouse Insert to Huge Table

The agreed pattern to insert new data into an already existing table in Azure Data Warehouse seems to be... create table dbo.MyTable_New with (distribution = round_robin) as select Col1 ,Col2 from dbo.MyTable union all select Col1 …
m1nkeh
  • 1,337
  • 23
  • 45
0
votes
0 answers

Repeated PKs in Dimension Table - SSIS

I’m a new learner to ssis and trying to build the data warehouse based on adventureworks database to find the most profitable product. Right now I have several dimension tables such as product dim sales dim date dim etc But when I was selecting…
Slowlearner_ac
  • 1
1 2
3
4 5 6 7 8