Questions tagged [parallel-data-warehouse]

A massively parallel database environment built on top of SQL Server and run from custom hardware. Parallel Data Warehouses use a modified version of T-SQL to support enhanced parallelization.

A massively parallel database environment built on top of SQL Server and run from custom hardware. Parallel Data Warehouses use a modified version of T-SQL to support enhanced parallelization.

Also known as Analytics Platform System. https://www.microsoft.com/en-us/sql-server/analytics-platform-system

51 questions
1
vote
1 answer

Drop large partition and recreate

I have a large fact table that contains one partition by year and month (yyyymm), I need to delete all data in a month and I think to delete and recreate the partition to make my work easier. My table has +200kk of rows and drops partition makes…
Rafael Lima
  • 420
  • 1
  • 5
  • 16
1
vote
1 answer

How to create stored procedure with Null input parameter in "Parallel Datawarehouse?"

I am creating a stored procedure to find tables available in a database in Microsoft Parallel Datawarehouse using SSMS 14 with two inputs parameters, name of table and schema. I tried this syntax for the SQL statement: ALTER PROCEDURE MY_SCHEMA.FIND…
vinayak
  • 11
  • 1
  • 3
1
vote
1 answer

location option must be specified when creating a temporary table in SSIS Parallel Data Warehouse

so i am loading data into a temp table in my data flow task and i keep getting the following error when i try to hit "Preview" location option must be specified when creating a temporary table
Kamran
  • 147
  • 4
  • 14
1
vote
2 answers

Data vault: Hash keys in staging table - advanced

I'm looking into using the datavault 2.0 methodology. I understand the reasons for hashing and trying to apply it. I'd like to apply this in the "staging" phase of the datavault rather than loading it into the DV. If a table has a business key in…
radialmind
  • 279
  • 2
  • 15
1
vote
1 answer

Alternative of sp_depends in Azure Data Warehouse

I need to get the list of tables used in a stored procedure,However in Azure Datawarehouse sp_depends is not supported. The other alternative I thought of having is to get the stored proc code from INFORMATION_SCHEMA.ROUTINES and then run a script…
Joseph
  • 530
  • 3
  • 15
  • 37
1
vote
2 answers

Connect Tableau to Looker database

I use Looker to manage my data stored in Amazon RedShift database. Though Looker has dash-boarding capabilities, I would like to use Tableau for better visualization. Is there a way I can connect Tableau to Looker database. (P.S: I don't wish to…
1
vote
1 answer

Connecting to Azure blob store via Shared Access Key in SQL Azure DatawareHouse using Shared Access Signature

I am getting error when trying to connect to Azure blob storage from Azure Data WareHouse Msg 105019, Level 16, State 1, Line 100 EXTERNAL TABLE access failed due to internal error: 'Java exception raised on call to HdfsBridge_Connect. Java…
1
vote
1 answer

Compare Azure Data WareHouse vs Azure Data Lake Analytics

How do Azure Data warehouse & Azure Data Lake Compare in respective to 1) External Table 2) Internal Table 3) Column store Clustered Index 4) connecting to Internal & External Table from SQL Server Management Studio to Internal/External Tables.
NSS
  • 1,835
  • 2
  • 29
  • 66
1
vote
2 answers

SQL: Arithmetic operations on aggregate functions in a select statement shows wrong information

I am working on a query for collecting some data on Microsoft Parallel data warehouse(PDW). A part of the query is as follows -- Select min(rows) as rows_min, max(rows) as rows_max, sum(rows) as…
PyCodoop
  • 40
  • 1
  • 7
1
vote
0 answers

Text Processing - Converting fixed width text files to delimited

I am not even sure if I am framing this question right, but I will try - I have a bunch of huge text files generated from oracle export on a Linux system. Each file is about 30 GB in size and I have about 50 of them. The goal is to export this data…
RK Kuppala
  • 356
  • 1
  • 2
  • 14
1
vote
2 answers

Azure SQL Data Warehouse hanging or not responding to simple query after large BCP operation

I have a preview version of Azure Sql Data Warehouse running which was working fine until I imported a large table (~80 GB) through BCP. Now all the tables including the small one do not respond even to a simple query select * from…
1
vote
1 answer

What is to be used in PDW inplace of identity

What is to be used in PDW inplace of identity or is there any other column which can be used instead of Identity column in Parallel Datawarehousing or any alternative how to generate sequentially increasing column.
0
votes
1 answer

Is single table with multiple updates better than multiple tables inserted at different times in Redshift

I have a task fact table with following columns Task ID (BIGINT) User ID (BIGINT) Created Timestamp (TIMESTAMP) First assigned Timestamp (TIMESTAMP) First assigned time taken (BIGINT) First comment Timestamp (TIMESTAMP) First comment time taken…
0
votes
0 answers

Evaluate number of compressed and uncompressed rows within a partition of a CCI

We are working on a Microsoft APS / PDW Appliance which consists of numerous huge tables. Most of these tables feature a Clustered Columnstore Index. For reasons of maintenance we implemented a process, which evaluates the number of compressed and…
Tyron78
  • 4,117
  • 2
  • 17
  • 32
0
votes
1 answer

Identifying orphaned tables in Microsoft SQL APS / PDW

We are facing severe performance issues on a Microsoft APS / PDW environment. Beside other tasks such as maintaining CCIs and statistics it was suggested to check for orphaned tables. A search on Google resulted in a query, which should help…
Tyron78
  • 4,117
  • 2
  • 17
  • 32