Questions tagged [sql-data-warehouse]

108 questions
0
votes
0 answers

Convert SQL query to MDX - have Group by & Count Functions

I have the following SQL query which I am trying to convert into MDX: select avg(skucount) from ( SELECT count(distinct [SKUCode]) as skucount --,[SHOPCODE_WITHOUT_DIST] FROM [HFPL_DW].[dbo].[FactSecondarySales] where DISTCODE in ( …
Alina Anjum
  • 1,178
  • 6
  • 30
  • 53
0
votes
1 answer

TFS Datawarehouse Report with "Acceptance criteria"

We are using TFS 2018 and we'd like to generate SSRS report on the test cases linked to acceptance criteria. Following are the issues: 1) Acceptance criteria field is not available in TFS_Datawarehouse. 2) Is there any recommended/best practices…
Aruna
  • 1
0
votes
1 answer

Copying Data from a dynamic URL to SQL DW

I am copying data from a JSON script into my SQLDW. I am using the Copy Activity from DF2 where my datasets are HTTP-Source and SQLDW-Target Everything is working fine until I set up a URL parameter for my HTTP LinkedService connection and then I…
0
votes
1 answer

Transactional data in data lake

We have multiple source systems sending data. Ideally we should capture the raw data coming from sources and keep it in data lake. Then we have to process the raw data into a structured format. Now users can update this data via a front end…
Lokesh Lal
  • 43
  • 1
  • 8
0
votes
1 answer

Connecting Azure Data Warehouse to Data Lake

From Azure Data Warehouse can we connect to Azure Catalog tables or Lake Store files as external tables? I want to be able to run SQL queries against the Azure Data Warehouse, but want to get the data from the Data Lake instead.
Vanamali
  • 47
  • 5
0
votes
1 answer

Resource Class - Concurrency - Azure SQL Data Warehouse

I have a question on how exactly resource class and concurrency work in ADW. I have configured a user account as staticrc30 (4 concurrency slots) and I am using this account from Tableau dashboard. My dashboard makes total of 12 queries to ADW. I am…
0
votes
1 answer

Is it possible to use system-versioned temporal table in the fact-dimension DWH design?

Say I want to implement SCD type2 history dimension table (or should I say table with SCD type2 attributes) in the DWH system which for now I has been implementing as a "usual table" with a natural key + primary surrogate key + datefrom + dateto +…
0
votes
1 answer

How to disable Geo backup policy in Azure SQL DW using java sdk

I have created Azure SQL Data warehouse and done pause and resume actions using Java SDK Now I want to disable Geo backup policy when creation of Azure SQL Data warehouse. How can I do it using Java SDK? Refer below image for Geo backup policy in…
Galet
  • 5,853
  • 21
  • 82
  • 148
0
votes
1 answer

Tool for Azure SQL data warehouse sync

I'm looking to automatically synchronise the data from an Azure SQL database to an Azure SQL data warehouse. It probably only needs to be inserting rather than updating, it will involve 25-35 tables and several million records in a few of the…
Mark W
  • 11
  • 1
-1
votes
1 answer

Can we use spark.sql on any other database tables other than Hive tables?

Currently our databases are hosted in other databases . We are thinking to execute the process in SPARK by using JDBC connectors. Is it possible to use SPARK.SQL statements after we connect the datasource or do we have to load the data to hive to…
-1
votes
1 answer

How to fit a separate table in data warehouse model?

I have a table named AWARENESS_MEETINGS with name and date of the meeting as an attributes, it's not related to any other table in the database. I am designing a data warehouse model, I can't fit it into the model its only related to the date…
-1
votes
1 answer

How to replace primary key with surrogate keys during ETL?

Have a question that is haunting me for some time. How in practice looks replacing primary keys with surrogate keys during the ETL process? Like what is the workflow - is it just assigning new IDENTITY? If so, how about previous values, how to…
-1
votes
1 answer

How do I replace "?" with NULL in SSIS expression?

There are ? in my data columns and I have to replace them with NULL. In my SSIS package.
zara rana
  • 59
  • 6
-1
votes
1 answer

Using MSFT SQL Server for data warehouse (star schema)

We currently have a Microsoft SQL Server instance (oltp) we use as our transactional and reporting database. We want to pull out and create a separate database for reporting. We are currently vetting Redshift and Snowflake. We came up with a…
johnsontroye
  • 281
  • 1
  • 3
  • 20
-1
votes
1 answer

Redshift - DataWarehouse Data Refresh

I have my data warehouse built on Amazon Redshift. The problem I am currently facing is, I have a huge fact table (with about 500M rows) in my schema with data for about 10 clients. I have processes that periodically (mostly daily) generates data…