Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

See architecture Impact Assesment


Data Architecture Design documents:

  • Data Architecture Blueprint :

    1. This document shows the architecture design for PCF 
    2. On the left side it denotes the sources used for PCF, it has mainly SAP ECC, BW, Gsheet, PURE, Ecoinvent ( External file)
    3. All these sources are extracting using the talend Talend to google cloud storage and then data has been sent to  staging area to perform then to ODS to Data mart and Views, 
    4. In final step the it is connected to dashboard in Tableau

Image RemovedImage Added

                                                       

  •   Data

    Lineage

    Model :

         The diagram represents the data lineage in PCF project 

Image Removed


Image Added

Image Added

Image Added

     

  •  Data Model :

     

Image Removed

Usage : fact_pcf is use by dashboards PCF, product list and breakdown to display PCF of a couple Finished Product / Site

Image Removed

usage : Fact_biogenic is to display on the dashboard the total amount of carbon of a couple Finished Product / Site






                  Data knowledge document represents the architectural artificats, it contains informations on source info, CRUD objects etc, below are the list of tabs and information present in the tabs: 

    1. Source Extraction & scheduling info : In this tab , there is information about sources ,filters and filters scheduling used in the project
    2. Data mapping : All the rules used to create the DM_V2, WDL tables
    3. Datalineage_V2 Lineage/Talend Job : In this tab THere is information on the data model and talend jobs used to create it
    4. CRUD Business Objects : This tab has information on the data objects/Data fields and its operation for example whether it is Created Read Updated or deleted, in this project most of the data object and data fields have been read in the GCP
    5. Technical Data Dictionary : This tab contains the information on the data fields and its technical name, table etc
    6. Table definitions : This tab has information on the tables  and its definitions
    7. Data Architecture diagram : It has data architecture diagram of project
    8. Data model : Data model diagram
    9. Data governance : This tab represent the data goverance information , it has been used by data goverance team
    10. Grain for tables : Keys of all the tables
    11.  Links : This tab has links on the infromation of the data rules, specification rules for creation of tables and BW query etc