Specific technical documentation for the Synthesis Lab tests
Pages
ELN data
Many files are extracted from Electronic Laboratory Notebook (ELN) which is responsable to gather many lab documents and result tests. It gives scientists a common view of data across disparate research areas, enabling complete visibility of research information.
Raw data
Raw data files are extracted for the filtration equipments. The files are available on google drive or on the lab servers. Raw data files structure is different for each scale. Therefore, the parsing of the raw data files and the computations for each scale are handled by different python scripts. This process and files are described in detail on each equipment page.
Raw data files for all labs are extracted from the servers or gdrive folders presented in the following spreadsheet: Asset Tag Spreadsheet
Talend jobs
Data is processed using Talend and Python. Talend jobs regarding Application Lab can be found in the Talend project RnI_Silica_Synthesis
Job F000_Orch_Flow_Application is the orchestrator and will call successively all the other jobs a determined order.
Python scripts
A copy of the Python scripts for downloading, parsing and computing new fields and columns for the Application Lab raw data and ELN data can be found here:
However it's recommended to get the last version of the scripts available in the production path: D:\DATA\PROD\RnI\Silica\Permanent. For the moment, git is not in place for this project.