Stack Overflow
Stack Overflow

Questions tagged [sql-data-warehouse]

108 questions
0
votes
0 answers

Optimize a Group By that is done on a joined table in Azure SQL Data Warehouse

I've been working at optimizing a query that I've been given, I'm curious if there is any way to speed up the following query that I have. This isn't the exact query that I am using but I think it serves to show what I am working with. (I'm using a…
toubi
  • 60
  • 8
0
votes
1 answer

Why can't we use data warehouse directly instead of database?

I am learning the Hadoop and came across the HIVE. And I learnt that HIVE acts a data warehouse for analytical queries. If data warehouse is aggregation of multiple data sources, why do the companies use multiple data sources and aggregate them? Why…
Ramana Reddy
  • 33
  • 3
0
votes
1 answer

As a part of initial load testing or incremental load testing do we validate audit fields?

We are performing initial load testing and incremental load testing on target tables in datawarehouse. so do we validate audit field values in initial load test or do we validate audit fields values in incremental load testing ? As part of which…
Naruto Uzumaki
  • 13
  • 1
0
votes
1 answer

Is there any equivalent is there for 'sp_refreshview' in Azure Synapse Dedicated SQL Pool

Is there any equivalent is available for 'sp_refreshview' in Azure Synapse Dedicated SQL Pool? When i tried , it shows below error. Since VIEWS WONT GET UPDATED AUTOMATICALLY, is there any other command or system stored procedure available in Azure…
Arulmouzhi
  • 1,878
  • 17
  • 20
0
votes
1 answer

DWH Reload data

In monthly increment loaded DWH I have task to create process to be able reload random month in the DWH. Lets say reload data for February 2021 in existing DWH. If I reload data for February 2021 on 2021/08/15, my SCD2 dimension Customer will end up…
ALdo
  • 75
  • 2
  • 13
0
votes
0 answers

Can we implement a table with data from another table that has the same ID but not the sime size in SQL?

i have table 1 (SERVICE) (ID_Service , ID_Vehicle ) and Table 2 (FACT) (ID_Veh , ID_Parts , Quantity ) i want to copy ID_Service to table FACT where ID_Vehicle=ID_Veh and affect to the rest Columns null when it doesn't match But the problem here…
Ranya Hfayedh
  • 21
  • 4
0
votes
2 answers

What is the diff between Full table vs Delta table vs Incremental in dwh oracle

I am trying to understand the concept Full Table vs Incremental Table vs Delta table and in principle in order to simplify (faster loading process) the daily ETL loads is it a good practice to use Incremental table FULL TABLE INCREMENTAL TABLE DELTA…
Data2explore
  • 452
  • 6
  • 16
0
votes
2 answers

ORA-00904: "S"."AIR_TIME": invalid identifier

Why does this code show invalid identifier when sum is used in distance and air_time column? When sum is not used this statement process successfully but using sum I get error? I need to use sum for this statement. MERGE INTO FACT_COMPANY_GROWTH F …
Aaheana
  • 1
  • 5
0
votes
1 answer

what are the steps I need to perform to clean the data if data into the dimension/fact table improperly loaded

Suppose there is a scenario where there is a data loading process into the fact table\dimensional table, and after analysis found that 100 millions records are being improperly loaded, what are the steps I need to perform to clean the data properly.
Abhishek Mitra
  • 61
  • 4
0
votes
0 answers

Create durable key in Data Warehouse

In dimension Project, there is business logic that Project Number and Project Name can change over time. Unfortunately, I cannot get any durable key directly from the source system. Is there a way how to deal with this situation? How to generate…
ALdo
  • 75
  • 2
  • 13
0
votes
1 answer

Dynamic SSIS package to load N tables from Oracle to SQL

We have N tables on Oracle server and we wanted to load all those tables from Oracle to SQL server. We are creating dynamic SSIS packages for same which will take the Oracle ServerName, DB name, schema name, tables list etc. and will load all these…
Ajit Medhekar
  • 1,018
  • 1
  • 10
  • 39
0
votes
1 answer

tempdb usage at Azure SQLDW

Can I track or get a report every 30 minutes to sum the tempdb usage by user id for AZureSQlDW? Any suggestions are highly appreciated Thanks, Cherishma.
princy
  • 3
  • 2
0
votes
1 answer

Should I apply type 2 history to tables with duplicate keys?

I'm working on a data warehouse project using BigQuery. We're loading daily files exported from various mainframe systems. Most tables have unique keys which we can use to create the type 2 history, but some tables, e.g. a ledger/positions table,…
Bjoern
  • 433
  • 3
  • 16
0
votes
0 answers

Should this table be a dimension table or a fact table in a data warehouse

The above Table has call center employee shift/target details OperatorID, User_Name as Operator Name, Team_Id, Team Name the Operator belongs to, FTE = number of days employee works in a week.(example: FTE = 0.8 = 6.4 Hours) Each row may or may…
Sai Abhiram Inapala
  • 359
  • 1
  • 9
0
votes
1 answer

DATEDIFF overflow

I am using the following code in azure sql datawarehouse SELECT cast(DATEDIFF(ms,cast(Start as datetime2),cast(EndTime as datetime2) ) as float) AS [total]--difference to be calculated in millisecond FROM…
Pradyot Mohanty
  • 139
  • 2
  • 12
1 2 3 4
5
6 7 8