3. Data Sources

3.1 - Source Descriptions

3.1.1 FTP Server

Connection details: 

• Host = ftp.meteologica.com
• Port = 21
• User = soda_ash

METEOLOGICA (FTP server):

CSV files containing data about the forecast energy prices by country - Spain, Italy, Germany, France. 

Folders:

• • /20160301/Europe/Spain/PowerPrice/Forecast/Meteologica/Total/Hourly
  • /20160301/Europe/Spain/PowerPrice/Forecast/ECMWF-ENS/Total/Hourly
  • /20160301/Europe/Spain/PowerPrice/Observation/Total/Hourly
  • /20160301/Europe/Italy/PowerPrice/Forecast/Meteologica/CNOR/Total/Hourly
  • /20160301/Europe/France/PowerPrice/Forecast/Meteologica/Total/Hourly
  • /20160301/Europe/Germany/PowerPrice/Forecast/Meteologica/Total/Hourly

Folder structure (Example, /20160301/Europe/France/PowerPrice/Forecast/Meteologica/Total/Hourly for 2023.08.26):

• • France_PowerPrice_Forecast_Meteologica_post-ECMWF-ENS_Total_Hourly_202308260000.csv (data from 10 am)
  • France_PowerPrice_Forecast_Meteologica_Total_Hourly_202308261333.csv (data from 2 pm)
  • France_PowerPrice_Forecast_Meteologica_Total_Hourly_202308261533.csv (data from 4 pm)
  • France_PowerPrice_Forecast_Meteologica_post-ECMWF-ENS_Total_Hourly_202308261200.csv (data from 10 pm)

Files with the same date contain the same data, provided 4 times a day.

Structure of the files (example France_PowerPrice_Forecast_Meteologica_post-ECMWF-ENS_Total_Hourly_202308260000.csv): 

All four files are consolidated into one file with the additional column datetime_forecasted.

The STG/ODS table format is given below (table structures will be provided as a part of the Talend integration documentation): 

The different format is presented only in the SPAIN_ENS data source where there are 50 ens column with the presented prices, and the top, bottom and average price columns. 

3.1.2 Database 

Connection details:

• Host = 34.140.71.199
• Port = 5432
• User = talend
• Schema = public
• Database = warehouse_ses_1

VENDOHM DATABASE: 

Gas & electricity (weekly, monthly, yearly values by location)

• • Tables with prices with the same structure (mapping is provided in the Excel file "List of tables_filters for Vendohm database of Robustify") 
    List of tables_filters for Vendohm database of Robustify
  • Meteo table curve_n_ometeo_870  (mapping with the definitions and curve IDs provided in the Excel file "Vendohm_meteo_mapping" -this should be provided as a Metadata table)
    Vendohm_meteo_mapping

Example of the structure (Vendohm data):

3.3.3 IRM DATABASE: 

Connection details:

• Host = acew1pirmdb01.prod.aws.cloud.solvay.com
• Port = 1530
• User = interface
• Schema = interface
• Database = IRMPROD

Information about energy deals by market, site, product, etc., with prices.

Example of the structure (IRM data):

3.1.4 Google Sheets

GSHEETS:

• • WAP Solid Fuels
  • CO2
  • Vendohm Forwards
  • Vendohm Spot
  • Energy Deals Hubs
  • Energy Deals Counter Parties
  • Energy Deals Sites Hedges
  • Hedging_soda_ash_table → obsolete

Example of the structure: