Attendees: 

Fernando Girante

Todd Tupper

Matteo Menghetti

Mukti Patel


Minutes for 30th May - Actions in red 

We have 3 weeks left on this project. 

Status of documents in scope

Scheduling_job_runs 

  • Delayed due to changes in approach and will now stick to using Talend. Fernando mentioned Talend does not cover all the complexities but can start a simple design 
  • Fernando to give inputs and rules to Matteo to document this week. Should include:
    • Define interface and request
    • what needs to be provided to implement scheduling
    • what the jobs, triggers, dependencies
    • what happens when jobs fails
    • description for approach

SCD

  • Fernando to review completed document with Joao Madrinha and then add to wiki this week

Security System

  • Click and Tableau guys use a spreadsheet to drive their security and permissions of who can access their platform, what they can view.
  • We need to build a model where we can provide a view for the tools to use for permissions
  • Fernando to speak to Paulo from Tableau to agree the model for Tableau to point to and use - To cover next week 

Data ingestion reference jobs

  • Matteo has started writing Talend Reference data jobs on the wiki and will complete by this week 
  • Matteo to write handling of reference data documents from next week after verifying with Joao and Youness

Terraform

  • Todd and Matteo to continue working on TerraForm to build and test data set tables and Matteo to add document to support this onto the wiki this week 
  • Need to finalise the way to create views on how the data product access data on the domain. To test and document

Wiki

  • We need to format our squad wiki so that we can have areas and these were proposed:
    • Talend
    • Biq Query
    • Architecture
    • GCP References
    • Data Engineer reference document
  • Fernando to add documents on wiki 

Issues raised this week

  • Pricing data need architect help from Salesforce to define data . Fernando mentioned speaking to them but not getting much help 
  • Pricing data lake are focusing to much on SAP and less time on SalesForce

Risks previously mentioned

  1. Fernando - Fail to identify the correct user requirements - Mitigation for architects to discuss in meetings and ensure the cases are clear using open discussions
  2. Matteo - A risk of what we build does not add a lot of value as the module does not fit the purpose. Our goal is for the users to use our standards and template but we can't force people to use it  - Mitigation of getting feedback from the pricing and PCF project users 
  3. Matteo - We are doing a lot of testing but none of it is the ideal solution as all product are using the projects and domain differently - Fernando mentioned we will review and improve throughout the future and do small increments and changes



  • No labels