ETL+ Extract, Transform and Load (ETL) (2)

Owned by Cortlandt _
Oct 04, 2023
4 min read

Hover over and/or right-click icons and objects on ETL+ to view their functions and/or metadata.

Source (Data Source) - Left Panel

Allows the maintenance of source systems' data, and finding/adding tables to the data warehouse.

1. Source panel:
- Lists mapped data sources and their tables (click the Refresh icon to list tables).
- Expand/collapse the list of tables by clicking the +/- icons by the data source header.

2. Source #1: Mapped source systems listed by name.

3. zData Warehouse: This ETL+'s data warehouse as a source for data manipulations.

4. Add Table: Select a table under a source and click Add Table icon to map it to the data warehouse.

5. Add Data Source: Click the icon to add a new data source.
See also https://dataself.atlassian.net/wiki/spaces/DS/pages/1570963898

6. Delete Data Source: Select a data source and click the icon to delete.

7. Refresh: Select a data source and click the icon to load or re-load its list of tables.

8. Properties: Changes the settings configured by Add Data Source.
Select a data source in the Source panel and click Properties to configure (connection string, alias, dw schema). See also https://dataself.atlassian.net/wiki/spaces/DS/pages/1570963898

Data Warehouse - Center Panel

Allows data warehouse table maintenance and data load.

9. Data Warehouse panel:
- Lists the tables and columns mapped to the data warehouse grouped by data source.
- Select a table to view its mapping on the ETL SQL Statement panel.
- Expand/collapse the list of tables by clicking the +/- icon by the Source Group (header).
- Double-click a table to enable expand/collapse +/- icons to list table columns.

10. Source Group: Lists data warehouse mapped tables grouped by source. Label: Source - Dw Schema.

11. Tables: List or mapped tables into the data warehouse (grouped by Source).

12. Table Columns: Double-click a table or right-click it → Show Columns -> click +/- to expand/collapse its list of columns.
- Label: ColumnName (data warehouse data type)
- PK icon: On columns that are part of the table’s PK.
- Column icon: On regular columns.
- Green Icon: The data warehouse column format has been edited by the user.
- Black icon: The data warehouse column format is the same as from the source.
To edit column data types and PK: select the Table → Design. More at: https://dataself.atlassian.net/wiki/spaces/DS/pages/1637023747

13. zData Warehouse Group: Lists mapped tables from the data warehouse re-imported into the data warehouse (for data manipulations). Group label: zData Warehouse - Dw Schema.

14. Create Table: Click icon to map a new data warehouse table from scratch. Name it and then create its ETL SQL Statement on the right panel.

15. Delete Table: Select a table and click the icon to delete it, click Yes to confirm.

16. Duplicate Table: Select a table and click the icon to duplicate it.

17. Rename Table: Select a table and click the icon to rename it.

18. Design: Select a table and click the icon to design the columns format and extra data manipulation.
More at: https://dataself.atlassian.net/wiki/spaces/DS/pages/1637023747

19. Preview Table: Select a table and click the icon to preview a sample of its records from the data source (ETL+ executes the top records from the ETL SQL Statement to preview).

20. Load Now: Select a table and click the icon to load its source data to the data warehouse.

21. Refresh Batch: Click the icon to configure and run Refresh Batches.
More at: https://dataself.atlassian.net/wiki/spaces/DS/pages/1571225805

ETL SQL Statement - Right Panel

Allows the maintenance of the SQL Statement for data load.

22. ETL SQL Statement: Editable text for the SQL statement of a table. Select a table on the center panel to view and/or edit its SQL statement. Use SQL Statement syntax of the data source - for instance, SQL View syntax for MS SQL Server sources, Providex syntax for Providex ODBC. See xxx for details.

23. Selected Table on the Data Warehouse Panel: Shows (Source - TableName) selected on the center panel.

24. Load Type: Controls how the data load process for the selected table.
More at https://dataself.atlassian.net/wiki/spaces/DS/pages/1571225705.

25. Confirm: ‘*' shows on this button when the ETL SQL Statement is being edited. Click Confirm to accept the changes. Or click on another table and click No to the 'Confirm changes?’ prompt.

Other

26. ETL+ Build
- Version number: vYYYY.MM.DDBB. Ex.: v2021.08.2703 means the 3rd build on 08/27/2021.
- 32 or 64 bits.

27. Log: Click the icon to retrieve ETL+ cloud log.
More at: https://dataself.atlassian.net/wiki/spaces/DS/pages/1570963835

28. Help: Click the icon to view this page’s knowledge page help.

29. Settings: Click the icon for ETL+ settings.
More at: https://dataself.atlassian.net/wiki/spaces/DS/pages/1570832586

30. Close: Close the current ETL+ session.

31. Save: ‘*' shows on this button when this ETL+ is being edited. Click Save to save the changes. Or click Close and Yes to ‘Leave without saving?' prompt. Clicking icons # 13, 14 and 19 automatically save changes.

32. Bottom left corner:

  • User: your ETL+ username currently logged to ETL+.

  • Entity: the Entity ID , Data Warehouse name connected to this ETL+ session. Ex.: abc,aa_dw3 = entity abc, data warehouse name aa_dw3.

Â