Data Import
Dynasys is daily refreshed from BW and SalesForce.
A global and unique process (common to all instances of one company) allows to manage files provided by those two applications. The goal is to :
- select or exclude some csv files
- make data compatible with our Unicode Standard
- import csv files in the Datahub (TEMP tables)
- force basic data in those tables
- apply defined controls to strategic data tables, if necessary revert to a previous snapshot of data
Here's the algorithm dedicated to inbound csv files :
Read files
- "Files creation dt" check
If current day = Monday, the file must have generated on Day-1 at the latest
Otherwise, the creation date of the file must be Day 0.
- "File to exclude" check
The setting file D:\DynaSys\Batchs\Settings\dscp_settings.ini on the backend server contains a list of files to exclude.
If the file is part of this list, it won't be processed.
Reworkd data
[To do]
Apply integrity controls
[To do]