ETL+ Metadata

Owned by Joni Girardi
Last updated: Apr 06, 2024 by Cortlandt _
2 min read

DataSelf ETL+ metadata provides ETL+ entities with information and execution instructions. Every setting and configuration seen on ETL+ pages are saved in the ETL+ metadata. Metadata tells ETL+ installations how to extract transaction data, what tables and columns should be extracted, where the data should be loaded to, and in what extraction schedule.
The ETL+ Metadata database is part of ETL+ Server.

Information Captured in ETL+'s Metadata

ETL+ metadata includes:

  • Names of source tables/files.

    • Names and data types of each column/field in the source table/file.

    • Unique/Primary keys and/or indexes.

  • ETL+ users' credentials

  • Source system names

  • Connection strings to connect to the source systems

  • Target tables and columns. See Target Objects.

  • ETL SQL Statements to extract data from a client’s source systems, the connection string to the data warehouse.

Metadata Seen on ETL+ Pages

Example of ETL+ configurations and settings stored in ETL+ metadata.

Description of the metadata shown on the screenshot above:

  • Data warehouse’s SQL instance and database name = [(local)].[DwTest]

  • Source connection string: source type = MS SQL Server; Server name = (local), Database name= ERP_Database

  • List of tables in the target data warehouse: Account, Account Class, Address

  • List of columns from the Address table: AddressID (int), AddressLine1 (varchar(50)), etc.

  • ETL SQL Statement for the Address table (right panel)

  • Email address of the user currently logged in to ETL+ (see User in lower left corner).

Data Not Captured in the Metadata

ETL+ metadata does not include clients' transaction data from data sources. The transaction data is securely extracted from source systems and loaded directly into the client’s data warehouse.