Stack Overflow
Stack Overflow

Questions tagged [polybase]

PolyBase enables SQL Server 2016 instance to process Transact-SQL queries that read data from Hadoop/Azure Storage. The same query can also access relational tables in your SQL Server. PolyBase enables the same query to also join the data from Hadoop and SQL Server. In SQL Server, an external table or external data source provides the connection to Hadoop.

179 questions
1
vote
2 answers

Azure Synapse Polybase/External tables - return only latest file

We have an files partitioned in the datalake and are using Azure Synapse SQL Serverless pool to query them using external tables before visualising in Power BI. Files are stored in the following partition format…
Will W
  • 95
  • 6
1
vote
1 answer

SQL Data Warehouse External Table with String fields

I am unable to find a way to create an external table in Azure SQL Data Warehouse (Synapse SQL Pool) with Polybase where some fields contain embedded commas. For a csv file with 4 columns as below: myresourcename, myresourcelocation,…
user2263025
  • 77
  • 2
  • 8
1
vote
1 answer

how to define date format in Azure synapse on demand

I am loading a couple of csv files using this Query SELECT     * FROM     OPENROWSET(         BULK 'https://xxxxxx.core.windows.net/jde/*.CSV',         FORMAT = 'CSV', FIELDTERMINATOR =',', FIRSTROW = 2…
Mim
  • 999
  • 10
  • 32
1
vote
0 answers

SQL Polybase External Table - Dealing with file metadata

I cannot find any reference for dealing with file metadata when creating an External Table starting from a partitioned source of files. More precisely: I have a set of partitioned parquet files. The partition strategy is in the…
Fabio Carello
  • 1,062
  • 3
  • 12
  • 30
1
vote
0 answers

Tabular Model and Analysis Service and ODBC

From SQL Server 2019, how do I connect to SQL Server Analysis Server (Tabular Model) / Azure Analysis Service using CREATE EXTERNAL DATA SOURCE command? I would like to connect to it using Polybase and extract data from the Tabular data model. I…
Gopinath Rajee
  • 400
  • 5
  • 20
1
vote
2 answers

Loading data from ADLS Gen 2 into Azure Synapse

I am trying to load Parquet files from ADLS Gen2 to Synapse using polybase external table feature. Below is the code, but when running the create external table command, the query never completes. On cancelling the query execution, i see this error…
shankar gopinath
  • 43
  • 2
  • 6
1
vote
0 answers

Upload to blob through SFTP in UTF-8 format

I am uploading some flat files to blob storage through SFTP. I need to convert them to UTF-8 format as I am using polybase. Is it possible to convert the files from ANSI to UTF-8 prior to uploading to blob. I am using python to upload, but unable…
sparc
  • 345
  • 1
  • 2
  • 13
1
vote
1 answer

Polybase unable to place a WHERE condition on XLSX destination

The WHERE condition in my T-SQL query is not returning any rows, from SQL 2019 polybase to .XLSX file Here's my code that created Polybase: create master key encryption by password = 'Polybase2CSV'; create external data source myODBCxlsx with …
RaviLobo
  • 447
  • 2
  • 10
  • 29
1
vote
1 answer

Create external data source in Azure Synapse Analytics (Azure SQL Data warehouse) to Oracle

I am trying to create external data source in Azure Synapse Analytics (Azure SQL Data warehouse) to Oracle external database. I am using the following code in SSMS to do that: CREATE MASTER KEY ENCRYPTION BY PASSWORD = 'myPassword'; CREATE DATABASE…
Ani
  • 11
  • 3
1
vote
0 answers

What is causing "The Remote Java Bridge has not been attached yet" when attempting to run a polybase query in linux mssql server 2019?

On a Centos 7 vm, we installed mssql server 2019 following the instructions here: https://learn.microsoft.com/en-us/sql/linux/quickstart-install-connect-red-hat?view=sql-server-linux-ver15 We then installed mssql-server-polybase following the…
Mike R
  • 11
  • 2
1
vote
2 answers

Polybase: Azure Sql DB cannot import blob storage

Is it true that Azure SQL cannot import blob storage? (SQLDW can and also stand alone instance) as given in this document, it cannot. But the document is from 2018. Has things changed after that?
Blue Clouds
  • 7,295
  • 4
  • 71
  • 112
1
vote
1 answer

Polybase converting sql to ansi sql for a sybase connection

I have a polybase connection to a sybase server. On my external tables I can not use the top command because poly-base converts it to limit Example: SELECT TOP (1000) * FROM [polygrab].[dbo].[ExtEvent_test] Cannot execute the query "Remote Query"…
crowley
  • 100
  • 1
  • 5
1
vote
1 answer

SQL Server 2019 PolyBase connection to SQL Server 2016 - Error

I was trying to setup a linked server between SQL Server 2019 and SQL Server 2016 but I have been consistently getting the error as below: CREATE EXTERNAL DATA SOURCE PolyBaseSQL WITH ( LOCATION =…
Gopinath Rajee
  • 400
  • 5
  • 20
1
vote
1 answer

Issue creating external tables from sql server to hadoop using polybase

We have recently installed Polybase in SQL Server. We are trying to use Hortonworks to get data. I am facing below issue while creating a external table. Msg 105019, Level 16, State 1, Line 1 EXTERNAL TABLE access failed due to internal error:…
prashanth
  • 11
  • 1
1
vote
1 answer

How to change extension and compression way?

I'm following the steps here. Q1: I success in exporting CSV. But the extension is TXT. Is it possible to change it to CSV? Q2: There are two compression methods provided, Gzip and Deflate. I've tried both. The extensions are gz and deflate. Is it…
Jeff_hu
  • 417
  • 4
  • 15
1 2 3
…
11 12