You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 11 Next »

Status

WIP

Stakeholders
Outcome
Due Date
Owner

SAUSSOL, Olivier 

Solution/Domain/Data Architect

TRIFFAUX, Eric PASQUALI, Laurent alexandre.mathe@syensqo.com

Most of the lab sites are equipped with File Server atop iOMega NAS, which is in some cases if malfunctioning also are running at the limit for adding more hard disks to accommodate new demands for storage and been compliant with data storage regulations.

[ TL;DR]... tbd

Use cases

  1. Lyon/RICL
    1. OpenLab instruments generate files at hundreds GB scale for some techniques which demands local computer power to load in stand alone applications for expert analysis, this magnitude size also makes it impossible to load these files to cloud repository as well as creating difficulties in being compliant with regulatory terms for storage.
  2. Shanghai
    1. Waters instruments demands 12TB space to store application data. This storage magnitute reaches the local limitation for LabPC disk and also for local network in the iOMega NAS.
  3. Bristol
    1. Waters instruments demands 12TB space to store application data. This storage magnitute reaches the local limitation for LabPC disk and also for local network in the iOMega NAS.


Questions and Concerns


Architectural Significant Requirements

  • Data rotation
  • Retention
  • Export Control/Cyber Sec
  • Access Control
  • Data transfer latency SLA
  • Data Consumers (data structure/data model)

Impediments and Blockers


Tradeoff analysis

  • Alternatives
    • XYZ
    • YZX 
      • Sensitivity Points
      • Risks
      • Non Risks
      • Architectural Approaches


Quick-Wins

The criticality of the problem demands that there be at least a temporary solution as an alternative to mitigate the immediate impact of losing sensitive data for the business due to the local storage limit at the current date.

Some questions that can facilitate the analysis:

  1. To this end, it is necessary to identify the business requirement for using locally stored historical data
  2. What type of search criteria is used on historical data?
  3. What retrieval is done on this found data?
  4. What type of processing is done on the found and retrieved data?
  5. Is it possible to parse this data?

Possible alternatives to consider in advance:

  1. Promote historical data close to the (AWS Landing Zone) ACD Labs domain so that it can be ingested for later analysis in reports
  2. Promote historical data close to the (GCP) Lab-Booster domain so that it can be ingested for later analysis in reports
  3. Promote historical data to the Azure Fabric Lakehouse so that it can be ingested for later analysis in reports


Design Solution Proposal



References

LABPC Storage needs consolidation https://docs.google.com/spreadsheets/d/1U-d6W2LEGV9mz4XK9hBmHg1FTZY_-oYxlkXKkukgSNQ/edit?pli=1&gid=0#gid=0



  • No labels