Questions tagged [warehouse]

A data warehouse is a system used for reporting and data analysis, which integrates data from one or more disparate sources into a central repository of data used for trending and reporting.

A data warehouse is a relational database that is designed for query and analysis rather than for transaction processing. It usually contains historical data derived from transaction data, but it can include data from other sources. It separates analysis workload from transaction workload and enables an organization to consolidate data from several sources.

In addition to a relational database, a data warehouse environment includes an extraction, transportation, transformation, and loading (ETL) solution, an online analytical processing (OLAP) engine, client analysis tools, and other applications that manage the process of gathering data and delivering it to business users.

http://en.wikipedia.org/wiki/Data_warehouse http://docs.oracle.com/cd/B10501_01/server.920/a96520/concept.htm

100 questions
1
vote
2 answers

Usage of timeInState function in Anylogic

So for my project in area of Industrial Engineering, I am making a warehouse simulation and optimization model in software Anylogic. I want to know the time my picker spends in being busy( that is moving) and so I came across this built-in function…
Anuj Jain
  • 11
  • 1
1
vote
1 answer

Surrogate vs Natural Primary Keys, *SPECIFICALLY* in a Data Warehouse. Is this debated?

Are Surrogate vs Natural Primary Keys generally debated in the world of data warehouses? To be clear - the natural keys would be there regardless. And by surrogate keys, I mean keys that don't exist in the source system, but are created as part of…
bbb0777
  • 165
  • 14
1
vote
0 answers

How to use resources for rackPick in anylogic?

I am using anylogic to simulate a warehouse. I use rackstore and rackpick to store and pick the items from the pallet-rack. When I use resources to pick the items, the Error Exception during discrete event execution: root.retrieval.attach: The agent…
1
vote
1 answer

Update changes in Azure SQL Data Warehouse using polybase

I want help regarding Azure SQL Data Warehouse, I'm using Polybase to ELT data from Azure Data Lake Storage Gen2 to Azure SQL DW. When we load data first time into DW no issues. But when we load data again/incremental load how do we upsert data?…
Soni007
  • 103
  • 2
  • 13
1
vote
2 answers

Relation between two Fact tables

According to data warehouse concepts, is it correct to have a relation (1-m or even m-m) between two fact tables? Twetter scenario would be an example. We can suppose that we have two Fact tables (Tweets and Users). If we want to know which user has…
Ziad Salem
  • 496
  • 13
  • 34
1
vote
0 answers

how does ColumnStore Index can retrieve data if it is not ordered?

i'm learning how to use columnstore in sql server and i can't figure out how it works. this is a normale rowstore sample: If we use columnstore it should look soemthing like this according to this article : now how is it possible to retrieve ross…
1
vote
0 answers

Using JBDC to read sql file in spark scala collecting Warehouse error

I am trying to read MySQL file using Spark Scala. Following is the code I tried val dataframe_mysql = sqlContext.read.format("jdbc") .option("url","jdbc:mysql://xx.xx.xx.xx:xx") .option("driver", "com.mysql.jdbc.Driver") .option("dbtable",…
1
vote
1 answer

Importing data from multiple SQL servers

We are looking at collecting data from partners' Microsoft SQL Servers and importing it into our own SQL Server. Part of what we want to do is to take all of their data separately and then combine it all together so that we can create baselines on…
MattC
  • 119
  • 2
  • 13
1
vote
1 answer

Odoo 8, Pull and Push rules managment

I have main warehouse with bar-code scanners i have these statues 1-when receiving raw materials this steps should be done with bar-code scanner A-Receiving B-Inspection C-Put Away(in stock) 2-when our branches request raw materials (raw materials…
1
vote
1 answer

Dimension with a surrogate key into itself (Data Warehouse)

I have an Employee dimension that I am using SCDs and Surrogate keys to track changes over time. Employee's business system key: EmployeeID Employee Surrogate key: EmployeeSCDKey I would like to have Manager information tracked over time as well.…
1
vote
2 answers

SQL Server Integration Services - Out of memory exception

I've created an ETL that has grown to populate about 250 tables (Staging Tables, Dimension Tables and Fact Tables). I got the ETL design pattern from Stacia Meisner, her ETL design pattern was based upon creating a template package for loading a…
Jesse Petronio
  • 693
  • 5
  • 11
1
vote
1 answer

How to find blocked queries in Azure SQL dataware house?

Is there is any way to check blocked queries in Azure Data warehouse?? In my monitoring tool it's shows two blocked queries during morning session. I need to find which queries are blocking...
Sha
  • 73
  • 2
  • 7
1
vote
1 answer

Columnstore index in warehouse table when selecting all columns

I have warehouse table with around 600 000 rows, and 20 columns. Number of rows tend to grow pretty fast. I usually need to execute just this query: SELECT * FROM MyTable WHERE EventDate BETWEEN @Date1 AND @Date2 Currently I have just clustered…
bambi
  • 1,159
  • 2
  • 14
  • 31
1
vote
0 answers

Create a transfer order with an Empty Vendor number

I have a requirement where I have to create a transfer order with empty vendor. The scenario is: The client wants to maintain its in-house stock, and in-house stock does not have any Special Stock no. (Vendor) in table LQUA. If this stock is…
Piyush Aggarwal
  • 172
  • 3
  • 11
0
votes
0 answers

Backup Microsoft fabric and prevent easy artifact deletion

We are considering to move our "classical" SQL data warehouse over to microsoft fabric. I noticed two things which both are possible showstoppers: I cant find any information on backups. How can we backup a fabric workspace (or at least a fabric…