Below you can find the release notes for the Pricing Data Lake in GCP, with the latest production release always at the top.

This overview is intended to highlight what is new or changed in each release, but is not intended as full documentation on the final state of the data.

Please consult the Data Directory for the full detail on each of the data objects in the lake.


Release

Data ObjectDescriptionNotes

2023 Q4.2

Dec 11, 2023

(UAT Only - no PROD release)



Sales History

Additional aggregations on top of the raw data from the Q4.1 release:

  • V_FACT_sales_history_orderline_month
  • V_FACT_sales_history_orderline
  • V_FACT_sales_history_cpc_month
  • V_FACT_sales_history_cpc
  • CPCs with data quality conflicts are currently being rejected from the dataset, so only 90% of revenue is accounted for in this release. Better heuristics on how to handle data conflicts are planned for Q4.4.
  • There are known issues on some fields such as Manufacturing Plant where business logic from Transparency has not yet been replicated in the Data Lake. Closing those gaps is planned for Q1 2024.
  • The current dataset is limited to quantity and revenue data. Other P&L elements are planned for Q1 2024.
  • The current release is limited to Novecare GBU. Extension to other GBUs will be WIP for Q1 2024.
Sales Forecast

Additional enrichment on top of the raw data from the Q4.1 release, enriching the forecast based on sales history data:

  • V_FACT_sales_forecast_enriched
  • Since the primary source for Sales Forecast enrichment is the Sales History dataset, the known issues described on Sales History are also impacting Sales Forecast. As we work on improving Sales History data, also Sales Forecast data quality will improve.
  • In Q1 2024 we will add a "unified timeline" dataset that merges the historical & forecast datasets into a single unified timeline at the CPC / month granularity.
  • In Q2 2024 we will extend the Sales Forecast views with cost forecast to come to FL ICM data by enriching the COPC07 data with COPA04 and COPC06 data.

2023 Q4.1

Nov 15, 2023


Exchange RatesAn additional Enriched view on FX rates to simplify usage of the FX rates within the Pricing tools. This enrichment adds exchange rates from all currencies to USD as a pivot currency (next to EUR), adjusts the forward FX rates for future months on CAR3, and adds 1:1 conversions to simplify FX processing.
  • V_DIM_exchange_rate_enriched

Sales History

Actuals on sales quantity and revenue, coming from BW COPA03. The data is checked for data quality and consistency. The data is provided in raw form only in this release. This view shows the data at the most granular level as coming from BW. This is shown per orderline, calendar month of the financial posting, and P&L element id

  • V_FACT_sales_history_raw
  • There are some known formatting issues on date fields and numeric fields which could not be fixed in time for release. These will be addressed in the Q4.2 release.
  • Additional aggregation levels are planned for Q4.2: at orderline level, CPC month level and CPC level.
  • CPCs with data quality conflicts are currently being rejected from the dataset, so only 90% of revenue is accounted for in this release. Better heuristics on how to handle data conflicts are planned for Q4.2.
  • The current dataset is limited to quantity and revenue data. Other P&L elements are planned for Q4.3.
  • The current release is limited to Novecare GBU. Extension to other GBUs will be WIP for Q1 2024.

Sales Forecast

Sales forecast quantity and revenue, coming from BW COPC07. This data is currently provided only in raw view.
  • V_FACT_sales_forecast_raw
  • Additional views are planned for Q4.2 including the Enriched forecast and a view on prior forecast runs.
  • In Q1 2024 we will add a "unified timeline" dataset that merges the historical & forecast datasets into a single unified timeline at the CPC / month granularity.
  • In Q2 2024 we will extend the Sales Forecast views with cost forecast to come to FL ICM data by enriching the COPC07 data with COPA04 and COPC06 data.

2023 Q3.4

Oct 11, 2023

 GBU Organizational hierarchy within Solvay, including GBU, activity, and group of activity.
Exchange Rates Exchange rates from local currency to EUR. The Data Ocean dataset contains all exchange rate types used for financial report, while the Pricing Data Lake view will be limited to CAR3 and CAR4.
  • This shows the Exchange rate data as it is available in BW.
  • Enhancements for Transparency planned for Q4.1 to include USD as a pivot currency and adjust forward rates.
Market Hierarchy of end use and market segments.
Region Hierarchy of country groupings into zones, mini-zones, sub-regions and regions.
Customer All master data attributes linked directly to customer accounts. This covers all customer types including soldtos and shiptos.
  • WP1, PF1 and Salesforce CORE data available. SpP extensions planned for Q4.2.
Product All master data attributes linked directly to product / materials. The dataset contains all material types from raw materials and intermediates up to finished goods and trading goods. This includes also attributes related to product hierarchy.
  • WP1, PF1 and Salesforce CORE data available. SpP extensions such as the H4 hierarchy are planned for Q4.2.
  • The dataset today contains all materials existing in Solvay, including technical materials (spare parts) which are not relevant for Pricing. A more filtered dataset is planned for Q4.2 to reduce volume of data.
  • There are a small amount of duplicates on the V_DIM_Material and V_DIM_Material_Group views due to data quality issues in the source systems. We are working on filtering these out by Q4.2.



  • No labels