Google cloud storage

Source system	GCS file	Description
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_ 0000_I_D_France_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	ROBUSTIFY/METEOLOGICA/FRANCE (/Archive \| /Processed)
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_ 0000_I_D_Italy_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	ROBUSTIFY/METEOLOGICA/ITALY (/Archive \| /Processed)
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_ 0000_I_D_Germany_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	ROBUSTIFY/METEOLOGICA/GERMANY (/Archive \| /Processed)
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_ 0000_I_D_Spain_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	ROBUSTIFY/METEOLOGICA/SPAIN (/Archive \| /Processed)
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_ 0000_I_D_Spain_ENS_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	ROBUSTIFY/METEOLOGICA/SPAIN_ENS (/Archive \| /Processed)
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_ 0000_I_D_Spain_OBS_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	ROBUSTIFY/METEOLOGICA/SPAIN_OBS (/Archive \| /Processed)
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Hedging_soda_ash_table.csv	ROBUSTIFY/GSHEET/HEDGING (/Processed)
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Marginal_cost.csv	ROBUSTIFY/GSHEET/MARGINAL (/Processed)
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_CO2_data.csv	ROBUSTIFY/GSHEET/CO2 (/Processed)
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Vendohm_forwards.csv	ROBUSTIFY/GSHEET_VENDOHM_FORWARDS (/Processed)
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Vendohm_spot.csv	ROBUSTIFY/GSHEET_VENDOHM_SPOT (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_eex_421_0.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_eex_421_1.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_eex_836.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_epex_26.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_gme_293.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_gme_364.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_mibgas_859.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_mibgas_861.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_ometeo_870.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_omie_32.csv	ROBUSTIFY/VENDOHM (/Processed)
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_pegas_291.csv	ROBUSTIFY/VENDOHM (/Processed)

STG tables

Overview

Source system	Source table/file	STG table	Description
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm} _0000_I_D_France_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	STG_FIL_0000_0000_F001_I_ D_france_powerprice_forecast_meteologica_total_hourly	Meteologica France
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm} _0000_I_D_Italy_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	STG_FIL_0000_0000_F001_I_ D_italy_powerprice_forecast_meteologica_total_hourly	Meteologica Italy
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm} _0000_I_D_Germany_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	STG_FIL_0000_0000_F001_I_ D_germany_powerprice_forecast_meteologica_total_hourly	Meteologica Germany
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm} _0000_I_D_Spain_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	STG_FIL_0000_0000_F001_I_ D_spain_powerprice_forecast_meteologica_total_hourly	Meteologica Spain
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm} _0000_I_D_Spain_ENS_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	STG_FIL_0000_0000_F001_I_ D_spain_ens_powerprice_forecast_meteologica_total_hourly	Meteologica Spain ENS
Meteologica FTP	FIL_IND_0000_0000_F001_{yyyymmddhhmm} _0000_I_D_Spain_ENS_PowerPrice_Forecast_Meteologica_Total_Hourly.csv	STG_FIL_0000_0000_F001_I_ D_spain_obs_powerprice_forecast_meteologica_total_hourly	Meteologica Spain OBS
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Hedging_soda_ash_table.csv	STG_FIL_0000_0000_F001_F_D_hedging_soda_ash_table	Hedging
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Marginal_cost.csv	STG_FIL_0000_0000_F001_F_D_marginal_cost	Marginal cost
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_CO2_data.csv	STG_FIL_0000_0000_F001_F_D_co2_data	CO2
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Vendohm_forwards.csv	STG_FIL_0000_0000_F001_F_D_vendohm_forwards	Vendohm forwards
GSHEET	FIL_IND_0000_0000_F001_{yyyymmddhhmm}_0000_F_D_Vendohm_spot.csv	STG_FIL_0000_0000_F001_F_D_vendohm_spot	Vendohm spot
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_eex_421_0.csv	STG_EXT_0000_0000_F001_I_D_curve_n_eex_421_0	n_eex_421_0
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_eex_421_1.csv	STG_EXT_0000_0000_F001_I_D_curve_n_eex_421_1	curve_n_eex_421_1
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_eex_836.csv	STG_EXT_0000_0000_F001_I_D_curve_n_eex_836	curve_n_eex_836
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_epex_26.csv	STG_EXT_0000_0000_F001_I_D_curve_n_epex_26	curve_n_epex_26
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_gme_293.csv	STG_EXT_0000_0000_F001_I_D_curve_n_gme_293	curve_n_gme_293
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_gme_364.csv	STG_EXT_0000_0000_F001_I_D_curve_n_gme_364	curve_n_gme_364
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_mibgas_859.csv	STG_EXT_0000_0000_F001_I_D_curve_n_mibgas_859	curve_n_mibgas_859
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_mibgas_861.csv	STG_EXT_0000_0000_F001_I_D_curve_n_mibgas_861	curve_n_mibgas_861
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_ometeo_870.csv	STG_EXT_0000_0000_F001_I_D_curve_n_ometeo_870	curve_n_ometeo_870
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_omie_32.csv	STG_EXT_0000_0000_F001_I_D_curve_n_omie_32	curve_n_omie_32
Vendohm	EXT_IND_0000_0000_F001_{yyyymmddhhmm}_0000_I_D_curve_n_pegas_291.csv	STG_EXT_0000_0000_F001_I_D_curve_n_pegas_291	curve_n_pegas_291

Tables

STG_FIL_0000_0000_F001_I_D_france_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_I_D_italy_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_I_D_germany_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_I_D_spain_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_I_D_spain_ens_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
ens00	FLOAT	NULLABLE	Price
. . .
ens50	FLOAT	NULLABLE	Price
top	FLOAT	NULLABLE	Price
bottom	FLOAT	NULLABLE	Price
average	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_I_D_spain_obs_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_F_D_hedging_soda_ash_table

Column name	Data type	Mode	Description
site	STRING	NULLABLE	Site
country	STRING	NULLABLE	Country
region	STRING	NULLABLE	Region
lat_long	STRING	NULLABLE	Latitude and longitude
month	INTEGER	NULLABLE	Month
year	INTEGER	NULLABLE	Year
commodity	STRING	NULLABLE	Commoditiy
direction	STRING	NULLABLE	Direction
volume	FLOAT	NULLABLE	Volume
unit	STRING	NULLABLE	Unit
price	FLOAT	NULLABLE	Price
currency	STRING	NULLABLE	Currency
date	DATE	NULLABLE	Date
budget_vol	FLOAT	NULLABLE	Budget volume
budget_price	FLOAT	NULLABLE	Budget price
proj_vol	FLOAT	NULLABLE	Projection volume
proj_price	FLOAT	NULLABLE	Projection price
forwards_price	FLOAT	NULLABLE	Forwards price
real_vol	FLOAT	NULLABLE	Real volume
max_vol_to_hedge	FLOAT	NULLABLE	Maximum volume to hedge
potential_gain	FLOAT	NULLABLE	Potential gain
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_F_D_marginal_cost

Column name	Data type	Mode	Description
date	DATE	NULLABLE	Date
week_day	STRING	NULLABLE	Week day
devnya_petcoke	FLOAT	NULLABLE	Devnya petcoke
devnya_russian_coal	FLOAT	NULLABLE	Devnya Russian coal
devnya_saf_coal	FLOAT	NULLABLE	Devnya saf coal
devnya_biomass	FLOAT	NULLABLE	Devnya biomass
dombasle_coal	FLOAT	NULLABLE	Dombasle coal
dombasle_biomass	FLOAT	NULLABLE	Dombasle biomass
rheinberg_coal	FLOAT	NULLABLE	Rheinberg coal
rheinberg_biomass	FLOAT	NULLABLE	Rheinberg biomass
torrelavega_coal	FLOAT	NULLABLE	Torrelavega coal
bernburg_anthracite	FLOAT	NULLABLE	Bernburg anthracite
devnya_anthracite_lumps	FLOAT	NULLABLE	Devnya anthracite lumps
devnya_anthracite_briquettes	FLOAT	NULLABLE	Devnya anthracite briquettes
dombasle_anthracite	FLOAT	NULLABLE	Dombasle anthracite
rheinberg_anthracite	FLOAT	NULLABLE	Rheinberg anthracite
rosignano_anthracite	FLOAT	NULLABLE	Rosignano anthracite
rosignano_metcoke	FLOAT	NULLABLE	Rosignano metcoke
torrelavega_anhracite	FLOAT	NULLABLE	Torrelavega anhracite
devnya_metcoke	FLOAT	NULLABLE	Devnya metcoke
dombasle_metcoke	FLOAT	NULLABLE	Dombasle metcoke
rheinberg_metcoke	FLOAT	NULLABLE	Rheinberg metcoke
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_F_D_co2_data

Column name	Data type	Mode	Description
year	INTEGER	NULLABLE	Year
site	STRING	NULLABLE	Site
free_allocation	FLOAT	NULLABLE	Free allocation
exchange_3rd_parties	FLOAT	NULLABLE	Exchange 3rd parties
adj	FLOAT	NULLABLE	Adj
hedges	FLOAT	NULLABLE	Hedges
vol_covered	FLOAT	NULLABLE	Vol covered
emissions	FLOAT	NULLABLE	Emissions
hedge_unit_cost	FLOAT	NULLABLE	Hedge unit cost
hedge_cost	FLOAT	NULLABLE	Hedge cost
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_F_D_vendohm_forwards

Column name	Data type	Mode	Description
id	INTEGER	NULLABLE	Id
source_table	STRING	NULLABLE	Source table
raw_curve_id	INTEGER	NULLABLE	Raw curve Id
name	STRING	NULLABLE	Name
commodity	STRING	NULLABLE	Commodity
contract	STRING	NULLABLE	Contract
timespan	INTEGER	NULLABLE	Time span
rolling	STRING	NULLABLE	Rolling
proprietary	STRING	NULLABLE	Proprietary
timezone	STRING	NULLABLE	Time zone
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_FIL_0000_0000_F001_F_D_vendohm_spot

Column name	Data type	Mode	Description
id	INTEGER	NULLABLE	Id
source_table	STRING	NULLABLE	Source table
raw_curve_id	INTEGER	NULLABLE	Raw curve Id
name	STRING	NULLABLE	Name
commodity	STRING	NULLABLE	Commodity
contract	STRING	NULLABLE	Contract
timespan	INTEGER	NULLABLE	Time span
proprietary	STRING	NULLABLE	Proprietary
timezone	STRING	NULLABLE	Time zone
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

STG_EXT_0000_0000_F001_I_D_curve_n_*

(curve_n_eex_421_1, curve_n_eex_836, curve_n_epex_26, curve_n_gme_293, curve_n_gme_364,
curve_n_mibgas_859, curve_n_mibgas_861, curve_n_ometeo_870, curve_n_omie_32, curve_n_pegas_291)

Column name	Data type	Mode	Description
id	INTEGER	NULLABLE	Id
raw_curve_id	INTEGER	NULLABLE	Raw curve Id
saved_date	DATETIME	NULLABLE	Saved date
published_date	DATETIME	NULLABLE	Published date
delivery_date	DATETIME	NULLABLE	Delivery date
value	FLOAT	NULLABLE	Value
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_file_name	STRING	NULLABLE	Meta column - source file name
meta_file_path	STRING	NULLABLE	Meta column - source file path
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS tables

Overview

Source system	STG table	ODS table	Description
Meteologica FTP	STG_FIL_0000_0000_F001_I_ D_france_powerprice_forecast_meteologica_total_hourly	ODS_FIL_0000_F001_I_D_france_powerprice_forecast_meteologica_total_hourly	Meteologica France
Meteologica FTP	STG_FIL_0000_0000_F001_I_ D_italy_powerprice_forecast_meteologica_total_hourly	ODS_FIL_0000_F001_I_D_italy_powerprice_forecast_meteologica_total_hourly	Meteologica Italy
Meteologica FTP	STG_FIL_0000_0000_F001_I_ D_germany_powerprice_forecast_meteologica_total_hourly	ODS_FIL_0000_F001_I_D_italy_powerprice_forecast_meteologica_total_hourly	Meteologica Germany
Meteologica FTP	STG_FIL_0000_0000_F001_I_ D_spain_powerprice_forecast_meteologica_total_hourly	ODS_FIL_0000_F001_I_D_spain_powerprice_forecast_meteologica_total_hourly	Meteologica Spain
Meteologica FTP	STG_FIL_0000_0000_F001_I_ D_spain_ens_powerprice_forecast_meteologica_total_hourly	ODS_FIL_0000_F001_I_D_spain_ens_powerprice_forecast_meteologica_total_hourly	Meteologica Spain ENS
Meteologica FTP	STG_FIL_0000_0000_F001_I_ D_spain_obs_powerprice_forecast_meteologica_total_hourly	ODS_FIL_0000_F001_I_D_spain_obs_powerprice_forecast_meteologica_total_hourly	Meteologica Spain OBS
GSHEET	STG_FIL_0000_0000_F001_F_D_hedging_soda_ash_table	ODS_FIL_0000_F001_F_D_hedging_soda_ash_table	Hedging
GSHEET	STG_FIL_0000_0000_F001_F_D_marginal_cost	ODS_FIL_0000_F001_F_D_marginal_cost	Marginal cost
GSHEET	STG_FIL_0000_0000_F001_F_D_co2_data	ODS_FIL_0000_F001_F_D_co2_data	CO2
GSHEET	STG_FIL_0000_0000_F001_F_D_vendohm_forwards	ODS_FIL_0000_F001_F_D_vendohm_forwards	Vendohm forwards
GSHEET	STG_FIL_0000_0000_F001_F_D_vendohm_spot	ODS_FIL_0000_F001_F_D_vendohm_spot	Vendohm spot
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_eex_421_0	ODS_EXT_0000_F001_I_D_curve_n_eex_421_0	n_eex_421_0
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_eex_421_1	ODS_EXT_0000_F001_I_D_curve_n_eex_421_1	curve_n_eex_421_1
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_eex_836	ODS_EXT_0000_F001_I_D_curve_n_eex_836	curve_n_eex_836
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_epex_26	ODS_EXT_0000_F001_I_D_curve_n_epex_26	curve_n_epex_26
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_gme_293	ODS_EXT_0000_F001_I_D_curve_n_gme_293	curve_n_gme_293
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_gme_364	ODS_EXT_0000_F001_I_D_curve_n_gme_364	curve_n_gme_364
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_mibgas_859	ODS_EXT_0000_F001_I_D_curve_n_mibgas_859	curve_n_mibgas_859
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_mibgas_861	ODS_EXT_0000_F001_I_D_curve_n_mibgas_861	curve_n_mibgas_861
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_ometeo_870	ODS_EXT_0000_F001_I_D_curve_n_ometeo_870	curve_n_ometeo_870
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_omie_32	ODS_EXT_0000_F001_I_D_curve_n_omie_32	curve_n_omie_32
Vendohm	STG_EXT_0000_0000_F001_I_D_curve_n_pegas_291	ODS_EXT_0000_F001_I_D_curve_n_pegas_291	curve_n_pegas_291

Tables

ODS_FIL_0000_F001_I_D_france_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_I_D_italy_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_I_D_germany_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_I_D_spain_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_I_D_spain_ens_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
ens00	FLOAT	NULLABLE	Price
. . .
ens50	FLOAT	NULLABLE	Price
top	FLOAT	NULLABLE	Price
bottom	FLOAT	NULLABLE	Price
average	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_I_D_spain_obs_powerprice_forecast_meteologica_total_hourly

Column name	Data type	Mode	Description
datetime_from	TIMESTAMP	NULLABLE	Date from
utc_offset_from	STRING	NULLABLE	UTC offset
datetime_to	TIMESTAMP	NULLABLE	Date to
utc_offset_to	STRING	NULLABLE	UTC offset
price	FLOAT	NULLABLE	Price
datetime_forecasted	TIMESTAMP	NULLABLE	Date and time forecasted - generated column
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_F_D_hedging_soda_ash_table

Column name	Data type	Mode	Description
site	STRING	NULLABLE	Site
country	STRING	NULLABLE	Country
region	STRING	NULLABLE	Region
lat_long	STRING	NULLABLE	Latitude and longitude
month	INTEGER	NULLABLE	Month
year	INTEGER	NULLABLE	Year
commodity	STRING	NULLABLE	Commoditiy
direction	STRING	NULLABLE	Direction
volume	FLOAT	NULLABLE	Volume
unit	STRING	NULLABLE	Unit
price	FLOAT	NULLABLE	Price
currency	STRING	NULLABLE	Currency
date	DATE	NULLABLE	Date
budget_vol	FLOAT	NULLABLE	Budget volume
budget_price	FLOAT	NULLABLE	Budget price
proj_vol	FLOAT	NULLABLE	Projection volume
proj_price	FLOAT	NULLABLE	Projection price
forwards_price	FLOAT	NULLABLE	Forwards price
real_vol	FLOAT	NULLABLE	Real volume
max_vol_to_hedge	FLOAT	NULLABLE	Maximum volume to hedge
potential_gain	FLOAT	NULLABLE	Potential gain
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_F_D_marginal_cost

Column name	Data type	Mode	Description
date	DATE	NULLABLE	Date
week_day	STRING	NULLABLE	Week day
devnya_petcoke	FLOAT	NULLABLE	Devnya petcoke
devnya_russian_coal	FLOAT	NULLABLE	Devnya Russian coal
devnya_saf_coal	FLOAT	NULLABLE	Devnya saf coal
devnya_biomass	FLOAT	NULLABLE	Devnya biomass
dombasle_coal	FLOAT	NULLABLE	Dombasle coal
dombasle_biomass	FLOAT	NULLABLE	Dombasle biomass
rheinberg_coal	FLOAT	NULLABLE	Rheinberg coal
rheinberg_biomass	FLOAT	NULLABLE	Rheinberg biomass
torrelavega_coal	FLOAT	NULLABLE	Torrelavega coal
bernburg_anthracite	FLOAT	NULLABLE	Bernburg anthracite
devnya_anthracite_lumps	FLOAT	NULLABLE	Devnya anthracite lumps
devnya_anthracite_briquettes	FLOAT	NULLABLE	Devnya anthracite briquettes
dombasle_anthracite	FLOAT	NULLABLE	Dombasle anthracite
rheinberg_anthracite	FLOAT	NULLABLE	Rheinberg anthracite
rosignano_anthracite	FLOAT	NULLABLE	Rosignano anthracite
rosignano_metcoke	FLOAT	NULLABLE	Rosignano metcoke
torrelavega_anhracite	FLOAT	NULLABLE	Torrelavega anhracite
devnya_metcoke	FLOAT	NULLABLE	Devnya metcoke
dombasle_metcoke	FLOAT	NULLABLE	Dombasle metcoke
rheinberg_metcoke	FLOAT	NULLABLE	Rheinberg metcoke
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_F_D_co2_data

Column name	Data type	Mode	Description
year	INTEGER	NULLABLE	Year
site	STRING	NULLABLE	Site
free_allocation	FLOAT	NULLABLE	Free allocation
exchange_3rd_parties	FLOAT	NULLABLE	Exchange 3rd parties
adj	FLOAT	NULLABLE	Adj
hedges	FLOAT	NULLABLE	Hedges
vol_covered	FLOAT	NULLABLE	Vol covered
emissions	FLOAT	NULLABLE	Emissions
hedge_unit_cost	FLOAT	NULLABLE	Hedge unit cost
hedge_cost	FLOAT	NULLABLE	Hedge cost
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_F_D_vendohm_forwards

Column name	Data type	Mode	Description
id	INTEGER	NULLABLE	Id
source_table	STRING	NULLABLE	Source table
raw_curve_id	INTEGER	NULLABLE	Raw curve Id
name	STRING	NULLABLE	Name
commodity	STRING	NULLABLE	Commodity
contract	STRING	NULLABLE	Contract
timespan	INTEGER	NULLABLE	Time span
rolling	STRING	NULLABLE	Rolling
proprietary	STRING	NULLABLE	Proprietary
timezone	STRING	NULLABLE	Time zone
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_table_name	STRING	NULLABLE	Meta column - source table name
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_ods_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_FIL_0000_F001_F_D_vendohm_spot

Column name	Data type	Mode	Description
id	INTEGER	NULLABLE	Id
source_table	STRING	NULLABLE	Source table
raw_curve_id	INTEGER	NULLABLE	Raw curve Id
name	STRING	NULLABLE	Name
commodity	STRING	NULLABLE	Commodity
contract	STRING	NULLABLE	Contract
timespan	INTEGER	NULLABLE	Time span
proprietary	STRING	NULLABLE	Proprietary
timezone	STRING	NULLABLE	Time zone
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_table_name	STRING	NULLABLE	Meta column - source table name
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_ods_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

ODS_EXT_0000_F001_I_D_curve_n_*

(curve_n_eex_421_1, curve_n_eex_836, curve_n_epex_26, curve_n_gme_293, curve_n_gme_364,
curve_n_mibgas_859, curve_n_mibgas_861, curve_n_ometeo_870, curve_n_omie_32, curve_n_pegas_291)

Column name	Data type	Mode	Description
id	INTEGER	NULLABLE	Id
raw_curve_id	INTEGER	NULLABLE	Raw curve Id
saved_date	DATETIME	NULLABLE	Saved date
published_date	DATETIME	NULLABLE	Published date
delivery_date	DATETIME	NULLABLE	Delivery date
value	FLOAT	NULLABLE	Value
meta_run_id	STRING	NULLABLE	Meta column - job run id
meta_md5_hsh	STRING	NULLABLE	Meta column - md5 hash
meta_execution_id	STRING	NULLABLE	Meta column - job execution id
meta_bucket_load_date	STRING	NULLABLE	Meta column - bucket load date
meta_business_date	TIMESTAMP	NULLABLE	Meta column - business date
meta_stg_insert_date	TIMESTAMP	NULLABLE	Meta column - insertion date
meta_source_system	STRING	NULLABLE	Meta column - source system

DM tables

Responsible & contact points:

Alessandro Mainardi - Project Owner
Simon Bourguignon - Delivery Manager
Alba Carrero/ Gaetan Frenoy - Product Owner
Rui Ferraz - Project Manager

Page tree

Objects

Google cloud storage

STG tables

Overview

Tables

STG_FIL_0000_0000_F001_I_D_france_powerprice_forecast_meteologica_total_hourly

STG_FIL_0000_0000_F001_I_D_italy_powerprice_forecast_meteologica_total_hourly

STG_FIL_0000_0000_F001_I_D_germany_powerprice_forecast_meteologica_total_hourly

STG_FIL_0000_0000_F001_I_D_spain_powerprice_forecast_meteologica_total_hourly

STG_FIL_0000_0000_F001_I_D_spain_ens_powerprice_forecast_meteologica_total_hourly

STG_FIL_0000_0000_F001_I_D_spain_obs_powerprice_forecast_meteologica_total_hourly

STG_FIL_0000_0000_F001_F_D_hedging_soda_ash_table

STG_FIL_0000_0000_F001_F_D_marginal_cost

STG_FIL_0000_0000_F001_F_D_co2_data

STG_FIL_0000_0000_F001_F_D_vendohm_forwards

STG_FIL_0000_0000_F001_F_D_vendohm_spot

STG_EXT_0000_0000_F001_I_D_curve_n_*

ODS tables

Overview

Tables

ODS_FIL_0000_F001_I_D_france_powerprice_forecast_meteologica_total_hourly

ODS_FIL_0000_F001_I_D_italy_powerprice_forecast_meteologica_total_hourly

ODS_FIL_0000_F001_I_D_germany_powerprice_forecast_meteologica_total_hourly

ODS_FIL_0000_F001_I_D_spain_powerprice_forecast_meteologica_total_hourly

ODS_FIL_0000_F001_I_D_spain_ens_powerprice_forecast_meteologica_total_hourly

ODS_FIL_0000_F001_I_D_spain_obs_powerprice_forecast_meteologica_total_hourly

ODS_FIL_0000_F001_F_D_hedging_soda_ash_table

ODS_FIL_0000_F001_F_D_marginal_cost

ODS_FIL_0000_F001_F_D_co2_data

ODS_FIL_0000_F001_F_D_vendohm_forwards

ODS_FIL_0000_F001_F_D_vendohm_spot

ODS_EXT_0000_F001_I_D_curve_n_*

DM tables