Overview
Data input from WebApp to Bigquery will go directly project prj-robustify-[env] in dataset DS_APP_Robustify for the tables name [site]_inputs
Then the data flow will be
- DS_APP_Robutify.[site]_inputs → DM.V_FACT_[site]_inputs to change row to column. (to change parameter name of webApp to be column in BQ)
- DM.V_FACT_[site]_inputs → DM.V_FACT_[site]_inputs_enr to add missing value if webApp does not have data, it will get from Data Ocean
- DM.V_FACT_[site]_inputs_enr → DM.V_FACT_[site]_inputs_queue to identify which records are not yet calculate by Dataiku. Status of the Dataiku will keep to DS_APP_dataiku. [site]_optimization_status
- DM.V_FACT_[site]_inputs_queue → DPS_APP_dataiku.[site]_outputs The data from DM.V_FACT_[site]_inputs_queue will process at the dataiku and send the output
- DPS_APP_dataiku.[site]_outputs → DM.V_FACT_[site]_output
- DM.V_FACT_marginal_[site] is the join tables on input and output and calculate marginal
API Documentation
Responsible & contact points:
- Alessandro Mainardi - Project Owner
- Simon Bourguignon - Delivery Manager
- Alba Carrero/ Gaetan Frenoy - Product Owner
- Rui Ferraz - Project Manager