ETL+ for MS SQL Server

Installation Checklist

Connecting to MS SQL Server

Connecting to source data stored on a Microsoft SQL Server database. See also https://dataself.atlassian.net/wiki/spaces/DS/pages/1991540909.

  • If you haven’t installed ETL+ yet: ETL+ Deployment Instructions.

  • Login to ETL+ (help here).

  • Adding a new SQL database: On ETL page’s left panel, click Add Source -> MS SQL Server.

  • Maintaining a MS SQL source: On ETL page’s left panel, right-click the MS SQL source → Properties.

  • On the Microsoft SQL Server page:

    • The Alias box will be automatically populated, but you can customize it.

    • Server name: the MS SQL Server instance name or IP address.

    • Authentication: select the correct one and its credentials if applicable. Read-only rights required.

    • Database name: The name of the SQL source database .

      • Click the Refresh icon on the right to load the list of database names.

      • Use the dropdown list and select the correct one.

    • Click Connect.

You’ll get back to the ETL page and see tables under the new SQL source on the left panel.
For more see https://dataself.atlassian.net/wiki/spaces/DS/pages/2001534977

Mapping and Loading Tables

  • To view tables available from your SQL database on the left panel, right-click the SQL source → Refresh.

  • To map a SQL table to the data warehouse, double-click its name on the left panel, or right-click on it → Add Table.

    • You’ll now see the table added/mapped to the center panel.

  • To preview its data, right-click the table on the center panel → Preview.

  • To load its data to the data warehouse, right-click the table on the center panel → Load Now.

  • Click the Log icon (top right) to view data load results. Log page help here.

Schedule the Data Load

  • On the ETL main page, click Refresh Batch (top right icon on the center panel).

  • Select a Refresh Batch or create a new one to load your SQL data on a schedule (help here) → on the right panel, be sure the SQL tables to load have their boxes checked and in the desired load order.

  • To load them now, click the Refresh Batch Now (play icon) on the left panel for the desired Refresh Batch.

  • To schedule the data load:

    • Click WTS Settings -> enter the WTS parameters → Apply.

    • This step might require you to run ETL+ app as “Run as administrator” in Windows.

  • Click Close -> Close.

Testing

After ETL+ has loaded your SQL tables, this is to check if the data extraction process finished successfully and row count per extracted table matches with your SQL tables.

Steps

  • Login to ETL+ (help here).

  • On the ETL main page, click the top-right Log icon. Log page help here.

  • Scroll down on the log page and double-check that no table load failed, and the row count matches with the source SQL tables. Following is an example highlighting two tables from a sample SQL database and their loaded row count.