We need to fill following parameter in order to connect BW on component tSAPConnection. Default context is already created for all BW systems.
The user to connect must be RFC_TAL_WBP, which is the RFC user for Talend (DE team). It already save in global context g_CNX_SAP_WBP
| Variable | SBX | DEV | QAS | PRE | PRD |
|---|---|---|---|---|---|
| sapClient | 400 | 110 | 400 | 400 | 400 |
| sapUser | RFC_TAL_WBP | RFC_TAL_WBP | RFC_TAL_WBP | RFC_TAL_WBP | RFC_TAL_WBP |
| sapHost | wb1.eua.solvay.com | wbd.eua.solvay.com | wbq.eua.solvay.com | wbv.eua.solvay.com | wbp.eua.solvay.com |
| sapSystemNumber | 20 | 48 | 32 | 85 | 00 |
| sapUserPwd | get it from Keepass |
To run the test, DE can select the system that you want to run, it will automatically connect to that system and get the result
It is required when FTP-Batch is used. This is require when we load a huge volume of data (more than 10,000 records), it is required to split the data and temporary save to the folder. To connect to RFC, we can use QAS folder to keep the file
It also already save in global context g_CNX_FTP_BW
| Variable | Value |
|---|---|
| ftpHost | wbq.eua.solvay.com |
| ftpFolder | /exploit/BW/test |
| ftpPort | 22 |
| ftpUser | sftpbw |
| ftpPwd | get it from Keepass |
This function is available only some component
| Variable | Meaning |
|---|---|
| l_VAR_GCS_CSV_TO_STAGING_BUCKETNAME | Bucket Name in GCS |
| l_VAR_FOLDER | Local path |
| l_VAR_FILE | Local filename |
| l_VAR_LIMITROW | Limit number of row per file. Required only tSAPTableInput |
| l_PATHDIR_GCS_CSV_TO_STAGING_SERVICE_ACCOUNT_PATH | Location path and file of service account (JSON file) |
More detail how to get GCP service account
OBJECT | Talend component | COMMENT |
|---|---|---|
InfoObject (master data) | tSAPTableInput | Delta No Filter Yes FTP-Batch Yes |
(old model) | tSAPDSOInput | Delta No Filter Yes FTP-Batch Yes |
(old model) | tSAPCubeInput | Delta No Filter Yes FTP-Batch Yes |
tSAPADSOInput | Delta Yes Filter Yes FTP-Batch No | |
BW Queries | tHttpRequest is used for Xtract | The best solution for query is Xtract and use tHttpRequest |
It is the same as ECC SAP Table just to connect to BW
Although Talend has the component to get data from infoObject but it is better to get it from table since the tSAPInfoobjectInput can't have filter and there is no FTP batch or load by starting row like tSAPTableInput. Therefore, it is better to use tSAPTableInput
There are 3 main servers that we need to setup
The query that will available on Xtract program need to mark flag Remote Access “By OLE DB for OLAP”
The query that mark this flag should have the technical name starting with
QV_ for Qlik
DE _for Talend that load to GCP for the new concept of data ocean
The flag must not be flagged in the cored query for BW, which name starting with BW_QRY_xxxx
It has to be done by BW developer and transport from WBD to WBP
1. Open Xtract Designer in a virtual machine having this application like bgsoa-wks116. Connect to the Xtract sever (XU server : ACEW1DXTRAXUS01:8082)
2. Create a job in Xtract ( No need to create connection since all connection should have been already created so you will only have to decide which one to use)
2.1 Click on New (or Edit then go to 3.5)
2.2 Select BW server. DE should use connection which use user RFC_TAL_WBP, which is dedicate for Talend and DE team not sure the one for Qlik
2.3 Enter the job name. The naming convention Landscape_QueryName such as PRD_DE_BW_QRY_XXXX (Query name to connect via Talend must starting with DE, therefore, it can differentiate with Qlik query that have starting name with QV)
2.4 To connect with BW query, it is required to select BW Cube
3. Define data source
3.1 Click on search and
3.2 Select MDX (or BICS) and enter the Query name to search
3.3 Select the query
3.4 Click on Load
3.5 It will get Metadata of the query. Select the characteristics and key figures that required. Default value at the parent node is the text. If we need the key of the characteristic, we need to select at the properties
Edit the variable to filter if required. Be careful that MDX and BICS input can be different in some fields like date format
In case you can't find the query in MDX, then select BICS(Beta). BICS will not possible to select key and text for the characteristics on this version
Click on "Load live preview" to check the setup is OK
3.6 Click on Run on the top menu. The detail job will appear and the URL that is required for Talend will appear
3.7 Click on Run again (Optional) at the below screen to test that the job is OK.
Now the job is running and ready for Talend to get the data
1. Copy the job J028_BW_Query_to_GCS to the new job
2. Edit the context variable on l_VAR_URL to the the URL that get from section Xtract 3.6
3. The job should upload the output to the GCS as we configure in the context
In case the query has variable, the URL will required to have parameter, it may required to modify it.
For example,
Xtract will generate URL like this:
http://ACEW1DXTRAXUS01:8085/?name=DEV_DE_BW_QRY_MVCOPP01_0021&Fiscper=