This page presents a specific documentation for Batteries data for the sites of Aubervilliers and NOH. 

Summary

Data Sources

ELN

Link to the data source details:

Instruments

The instrument files are, most of them, manually added to a Google Driver's folder or a folder in lab servers. 

The spreadsheet Where to find instrument files? has the full list of instrument folders and location:

Data Mapping

Data mapping is divided in three steps:

Data Preparation or Parsing

The spreadsheet below presents all data transformation between the raw files (extracted files) and a BigQuery delta table. Some files are unstructured and semi-structured. This steps aims to structure the files in the target table format and checking if the column's type (schema) are conformed expected.

Data Integration or Computing

The spreadsheet below presents all data transformations between the tables on Staging and ODS. This steps aims to add some calculations and intelligence to the data. Not all tables will need passing through this step.

Data Presentation or DW/DM

Data Model

The data model presents the tables/views presented on DW/DM dataset and the relation between them.  

Specific Naming Conventions

Folders and Table Names

Most files are organized based on its "Workflow name", "Method name". For exemple:

All instruments folders structure and tables name use the same logic depending on the file or table format. For exemple:

Folders

Tables (Staging)

Abbreviations

Abbreviations specifically for Battery, they are used in the Talend jobs or tables names: