ETL+ Extract, Transform and Load (ETL) Page
Quick links | ||
---|---|---|
10. ETL Source panel |
Data Warehouse info: The target database/data warehouse that is loaded with data extracted from the ETL Sources and ETL Objects. Name of the data warehouse connected to this ETL+ session. The info shows as
[<MS SQL Instance Name>]
.[<Database name>]
.Find. Click to open the search box. (shortcut:
Ctrl + F
)Log. Click to open the ETL Log page. (shortcut
Ctrl + G
)Help. Click to open documentation for this ETL+ page in a web browser (shortcut
F1
)Settings. Click to open the Settings page.
Version number: format:
vYYYY.MM.DDBB
.Example:
v2022.08.2901
means the 1st build on 08/29/2022.
ETL+ User name and Entity for the current session.
User: the ETL+ username (email address) that is currently logged to ETL+.
Entity: the Entity identifies the mappings shown on this page.
Close. Click to close the current ETL+ session.
To close without saving changes click Close and click Yes to the ‘Leave without saving?' prompt.Save. Click to save changes (shortcut
Ctrl + S
).An asterisk indicates there are unsaved changes.
Create Table, Delete Table, Load Now and other functions automatically save changes.
NOTES: Hover over and/or right-click icons and objects on ETL+ to view their functions and/or metadata.
ETL Source Panel
Names and maintains connections to data sources.
ETL+ reads a wide variety of data sources.
See https://dataself.atlassian.net/wiki/spaces/E2/pages/1968541015, https://dataself.atlassian.net/wiki/spaces/DS/pages/1667629083Lists configured data sources and their tables (click Refresh to list tables).
Expand or collapse the display of tables/files in a data source by selecting
+
or-
next to the data source name.
ETL Source panel of ETL+ Extract, Transform and Load (ETL) window. |
|
Data Sources
Data sources are source systems (data sources) available to extract data.
zData Warehouse
-- Default Data Warehouse
zData Warehouse
is the default, destination data warehouse. Read and write-back data to transform data already in the data ware. See also zData Warehouse (Reimports) in the ETL Objects panel.
Used to created calculated fields, apply formulas, run SQL functions and make other data manipulations to the data warehouse.
How to Expand the Data Source in the ETL Source panel
To show the names of the tables in
|
Related Pages: https://dataself.atlassian.net/wiki/spaces/E2/pages/1968540238, https://dataself.atlassian.net/wiki/spaces/E2/pages/1968541015 , https://dataself.atlassian.net/wiki/spaces/DS/pages/1816887297
ETL Objects Panel
Configures the mapping of ETL Sources to the data warehouse zData Warehouse (Reimports). Allows data warehouse table maintenance and data load. Lists the tables and columns mapped to the data warehouse grouped by data source.
x x x x x x x |
|
NOTES
Select a table to view its mapping on the ETL SQL Statement panel.
Expand/collapse the list of tables by clicking the
+/-
icon by the Source Group (header).Double-click a table to enable expand/collapse.
Source Groups
A source group is defined as a list of data warehouse tables mapped to a data source in the ETL Source panel.
zData Warehouse (Reimports) is a pre-defined source group linked to the data warehouse. This source group lists mapped tables from the data warehouse re-imported into the data warehouse (for data manipulations).
Tables
Tables represent tables in the data warehouse.
Account
, AccountClass
, etc. through Sub
are tables in OData v4.
Table Columns
Every table consists of one or more table columns.
Double-click a table or right-click it → Show Columns → +/-
to expand/collapse its list of columns.
Types of Table Columns
PK (Primary Key) icon: Columns that are part of the table’s primary key.
Black Column icon: The data warehouse column format is the same as from the source.
Green Column Icon: The data warehouse column format has been edited in the Design page.
How to edit column data types and PK
Select a Table in the ETL Objects panel → Design. More at: https://dataself.atlassian.net/wiki/spaces/E2/pages/1968539374
ETL SQL Statement Panel
Edits the SQL code (SQL statements) that controls the mapping of the source data connections in the ETL Source panel to the data warehouse tables in ETL Objects panel.
Each SQL statement corresponds to a source group and table from the ETL Objects panel. The output of the SQL SELECT
statement loads into the destination data warehouse displayed just below the page title. See Data Warehouse info.
Display of the names of the corresponding source group and table on the ETL Objects panel.
ETL SQL Statements. Editable text of SQL code/statement.
To view or edit SQL for a table: Select a table on the ETL Objects panel. The corresponding SQL statement should appear in the ETL SQL Statement panel.
Use the SQL Statement syntax of the data source. Look at the SQL syntax for MS SQL Server sources in MS SQL Server, Providex syntax for for the Providex ODBC, etc.
Load Type: Controls how the data load process for the selected table.
More at https://dataself.atlassian.net/wiki/spaces/E2/pages/1968538781.Confirm. Click Confirm to accept the changes.
To reject the changes click on another table and click No to the Confirm changes? prompt.A asterisk indicates that the SQL has been edited.
v2022.08
/ex