Stack Overflow
Stack Overflow

Questions tagged [data-vault]

Data Vault is a methodology and architecture created to address the business of designing, implementing, and managing a data warehouse.

73 questions
0
votes
0 answers

What is the data vault model of a data model containing two tables having multiple relationships?

Data Model in question The data model has an employees table making two identifying relationships with qa table which is further making a non-identifying relationship with qa strategy table. At the same time the employees table makes three…
Bilal Nadeem
  • 1
  • 1
0
votes
0 answers

Data Vault - Deleted record from Multi Active Satellite

I am trying to figure out how to handle following situation. I have a table in source system, which ends up as MAS in our system, let's call the table A, the related hub that is filled by it H_A and the related MAS sat as MAS_A. The table 'A' holds…
Filip Kraus
  • 2,714
  • 2
  • 14
  • 16
0
votes
0 answers

Data Vault model for an insurance use case

I am currently working on an insurance use case and would like to apply a Data Vault 2.0 modeling approach to solve this challenge. Following scenrio: A contract was initially created on 28 March but will be effective on 01 April. Now in June there…
uet
  • 13
  • 6
0
votes
1 answer

How can I monitor a CSV file in Azure blob store for newly added records, similar to unix "tail -f"?

Context: I am an information architect (not a data engineer, was once a Unix and Oracle developer), so my technical knowledge in Azure is limited to browsing Microsoft documentation. The context of this problem is ingesting data from a constantly…
Russell Searle
  • 11
  • 3
0
votes
1 answer

SCD Type-2 Using INSERT strategy

I am using Data vault 2.0 model. Here we are not supposed to use UPDATE in a table. Normally in RDBMS, we implement SCD-2 using UPDATE & INSERT strategy. But in my case, I can use only INSER strategy. My Source is Kafka input and its loaded into…
Jomy
  • 87
  • 1
  • 13
0
votes
1 answer

How to create the LINK in data vault without having strong relationship keys (Foreign Keys)?

Our sales representatives call Leads to propose services. Leads are stored in Crm with attributes: LeadId, PrimaryContactNumber, SecondaryContactNumber. All calls are done via Teams and recorded. Calls could be extracted via Microsoft Graph Api and…
DmitriBodiu
  • 1,120
  • 1
  • 11
  • 22
0
votes
0 answers

Modelling INFORMATION_SCHEMA with Data Vault

I'm trying to model a kind of INFORMATION_SCHEMA using data vault approach for detecting of data lineage and I'm a bit confused about how to implement the relationship between tables and their columns. Some columns have the same name, like ID or…
korbee82
  • 107
  • 1
  • 6
0
votes
1 answer

Populating Effectivity Satellites and handling out of order change events

In https://www.linkedin.com/pulse/data-lt-mysteries-effectivity-satellite-driving-key-patrick-cuba/?trk=read_related_article-card_title Patrick Cuba showed how the insert-only logic work when populating an effectivity satellite. However when…
Jacob Wang
  • 4,411
  • 5
  • 29
  • 43
0
votes
1 answer

In data vault 2.0 can we connect a link and a hub through another link?

In data vault 2.0 can we connect a LINK and a HUB through another LINK? and can we connect 2 links too or there should be always 2 hubs through a link and that's it? I have an observation LINK, connecting related fields HUB holding info being…
alim1990
  • 4,656
  • 12
  • 67
  • 130
0
votes
1 answer

Data Vault 2 can we build the satellites without having primary key defined?

I am working on building a simple data vault model to upload it into snowflake. I am having a some sort of problem in all satellites. I know that adding auto incement surrogate keys into a sat is neither wrong nor practical, which means we can add…
alim1990
  • 4,656
  • 12
  • 67
  • 130
0
votes
1 answer

How to build a Multi-Active Satellite table from a table containing json query?

I have a table like follow: id |first_active |openingtimes_json 8326cdd20459|1970-01-01 01:00:00+01…
Amir
  • 399
  • 1
  • 7
  • 25
0
votes
2 answers

Modeling the Salesforce Polymorphic relationship in Data Vault 2.0 methodology

Occasionally Salesforce Object have polymorphic relationships with other Salesforce Objects. In a polymorphic relationship, the referenced object of the relationship can be one of several different types of object. These polymorphic relationships…
Saqib Ali
  • 3,953
  • 10
  • 55
  • 100
0
votes
1 answer

Storing dictionary values in the Data Vault DWH

Let's say I have some entity, for example Order. It can have status attribute, let's say with a code N what would mean "new order". There is another dictionary table that holds all of these order statuses values. How to design the database structure…
Dmitrij Kultasev
  • 5,447
  • 5
  • 44
  • 88
0
votes
0 answers

Expanding data vault for new requirements

Environment: I have a hub table for logging information about processes. The hub contains start time, end time, success/failure of the process. Desired change: Some of the processes receive a list of work items. I'd like to capture counts for those…
Jay
  • 13,803
  • 4
  • 42
  • 69
0
votes
1 answer

How can I iteratively "INSERT INTO {table} SELECT FROM".... for a range of dates?

I am working on a building a Data Vault Temporal Point in Time (TPIT) table. For this I need to iterate through a list of dates and insert rows for each Date. Here is the SQL for one Date '2020-08-19' . I need to iterate over all dates from year…
Saqib Ali
  • 3,953
  • 10
  • 55
  • 100
1 2 3
4
5