Common · Knowledge
Data vault modeling
Database modelling method with long-term historical storage that enables tracking of values and load dates back to their sources for auditing
Datavault or data vault modeling is a database modeling method that is designed to provide long-term historical storage of data coming in from multiple operational systems. It is also a method of looking at historical data that deals with issues such as auditing, tracing of data, loading speed, and resilience to change, as well as emphasizing the need to trace where all the data in the database came from.
From Wikipedia
Datavault or data vault modeling is a database modeling method that is designed to provide long-term historical storage of data coming in from multiple operational systems. It is also a method of looking at historical data that deals with issues such as auditing, tracing of data, loading speed, and resilience to change, as well as emphasizing the need to trace where all the data in the database came from. This means that every row in a data vault must be accompanied by record source and load date attributes, enabling an auditor to trace values back to the source. The concept was published in 2000 by Dan Linstedt. Data vault modeling makes no distinction between good and bad data ("bad" meaning not conforming to business rules). This is summarized in the statement that a data vault stores "a single version of the facts" (also expressed by Dan Linstedt as "all the data, all of the time") as opposed to the practice in other data warehouse methods of storing "a single version of the truth" where data that does not conform to the definitions is removed or "cleansed". A data vault enterprise data warehouse provides both a single version of facts and a single source of truth. The modeling method is designed to be resilient to change in the business environment where the data being stored is coming from, by explicitly separating structural information from descriptive attributes. Data vault is designed to enable parallel loading as much as possible, so that very large implementations can scale out without the need for major redesign. Unlike the star schema (dimensional modelling) and the classical relational model (3NF), data vault and anchor modeling are well-suited for capturing changes that occur when a source system is changed or added, but are considered advanced techniques which require...
Text: Wikipédia, CC BY-SA 4.0. · Image: Carbidfischer (CC BY-SA 4.0) ·
Related cards
-
E★★
Entity–attribute–value model
Type of space-efficient data model
-
D★
Data wrangling
Restructuring data into a desired format; process of transforming and mapping data from one "raw" data form into another format with the intent of making it more appropriate and valuable for a variety of downstream purposes such as analytics
-
★★★
Big data
Information assets characterized by such a high volume, velocity, and variety to require specific technology and analytical methods for its transformation into value
-
★★
Data model
An abstract model that organizes elements of data and standardizes how they relate to one another and to real world entities.
-
★★
Hierarchical database model
Tree-like database model
-
D★
Data integration
Combining data from different sources and providing a unified view