This page aims to show how the data gets into and how it's stored on BigQuery. It's a conceptual representation of the data objects, the associations between them, and the rules. It will start from a high level perspective until getting to a more detailed view.
Summary
Macro Data Schema
Schemas
All schemas can be found on the following GDrive link:
#133 Battery Data management platform >> 06 - Documentation >> Architecture >> Battery Data Scheme and Diagrams
Datasets
Access_rights
Supports data to allow user's access to some categorized data.
Datasets ARCHIVED
These dataset are now archived. Their data is already available on raw_data_ELN_EWHA.
ARCHIVED_raw_data_ELN_corp
ARCHIVED_raw_data_ELN_spechem
ELNHistoricalData
Historical pré-ELN data (MUSigma data). There are no updates but the data is used in some calculations for other datasets.
Raw_data (Ewha)
Raw data from Ewha cycler machines.
raw_data_BOLLATE
Raw data from Bollate cycler machines.
raw_data_ELN_EWHA
Old ELN templates raw data from Ewha. The data updates are meant to stop, but the data should be kept.
raw_data_ELN_BOLLATE
Old ELN templates raw data from Bollate. The data updates are meant to stop, but the data should be kept.
raw_data_ELN_BOL_EWHA
Dataset for the ELN standard template for Bollate and Ewha.
technical_data
All stage or intermediate tables. This a technical database used for integration and computation. Usually the data here will come from the "raw data" datasets and they will flow to a enriched dataset.
enriched_data
Cleaned, consolidated and integrated data.
enriched_data_user
Report purposes dataset. The objects are created and maintained by the Tableau developers.