Architecture Data Flow

Schema showing the different STEPS of the application flow - with the data involved at each step

DataApp Flow

Steps descriptions

Describe the data and process involved at each step

ML App

Description

What does it do ?

 

Tools

The tool used

Access rights

Is there any credentials used ? Where are they stored ?

Validation process

How to validate that this output match business expectations

Configuration

which kind of information or configuration this step uses ?

Source locations

Where is the data coming from ?

Source formats

The format of the source datasets

Destination locations

Where is the data stored ?

Destination formats

The format of the data output

Sizing

Expected data volume

Scheduling

Is there an automatic schedule ? At what frequency ? What is the trigger ?

Timing

The average time expected for :

  • full process
  • incremental process

Criticality

High / Medium / Low

Logging

Logging location

Other Step ?

Same again !

  • No labels