Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titleDownload, Release Notes, Release Date

Download file

64 bits: https://dataself.com/etl_plus/DataSelf ETL Plus - Beta 2021.07.2203.exe

Released: 07/22/2021

New Features

  1. UI: Many buttons have been replace by icons.

  2. UI: Mousing over icons shows tooltips with the icon function name and/or metadata.

  3. UI: Contextual icons - they are grayed out when they don’t apply to selected objects (ex.: selecting a table on the Source panel disables Delete Data Source).

  4. UI: Right clicking on the left two panels pops up the icon functions. The pop ups show the icons and their function names.

  5. UI: Clean up of the ETL+ main page (some functions have been moved to other pages).

  6. Multiple data sources: When opening ETL+, the data source(s) will not list its table names by default. This enables a fast opening of ETL+ since it doesn’t have to wait to list source system table names dynamically. Click a data source and the ‘Refresh’ icon to list its table names - this process can take several seconds if the source system is slow to render its table name list.

  7. Multiple data sources: Imports data from multiple data sources within the same ETL+ entity.

  8. Multiple data sources: Source panel shows all data sources created.

  9. Multiple data sources: Data sources are represented by a cylinder icon, and their table name list can be expanded or collapsed with the +/- icon by the data source icon. Tables are represented by a square window icon.

  10. Multiple data sources: Select a table from a data source and click the ‘Add Table’ icon/function to map it to the ETL process.

  11. Multiple data sources: Click the ‘Add Data Source’ icon/function, select a data source type (CSV, MS Excel, MS SQL Server, OData, ODBC), configure the connection information, click Connect (or Save if available).

  12. Multiple data sources: Configuration of data sources now includes an Alias (DSN Alias).

  13. Multiple data sources: Configuration of data sources now includes a ‘Dw Schema’ checkbox. When checked, tables from this data source will be stored in the data warehouse using a SQL schema = DSN Alias. When unchecked, tables will be stored in the default data warehouse SQL schema.

  14. Multiple data sources: In the DSN configuration page, use the ‘Change Data Source’ icon to replace it to another type (ex.: from OData to MS SQL).

  15. Multiple data sources: The DSN pages have a Save button (helpful when doing remote DSN maintenance without access to the DSN).

  16. Multiple data sources: Select a data source and click the ‘Delete Data Source’ icon/function to delete.

  17. Multiple data sources: Select a data source and click the ‘Refresh’ icon/function to reconnect to the data source and list its tables.

  18. Multiple data sources: Select a data source and click the ‘Properties’ icon/function to configure its settings.

  19. Multiple data sources: Mousing over the left panel’s data source icons shows its metadata.

  20. Multiple data sources: Mousing over the left panel’s tables from a data source shows its metadata.

  21. Multiple data sources: The center panel organizes the data warehouse tables by data source alias.

  22. Multiple data sources: The center panel data source alias icon is a square with 3 objects in it. You can expand/collapse the list of data warehouse tables with the +/- icon by this icon.

  23. Multiple data sources: Mousing over the center panel’s data source alias icons shows its metadata.

  24. Multiple data sources: Mousing over the center panel’s tables shows its metadata.

  25. Multiple data sources: When a data source has its table names listed on the left panel, and the user clicks that same table on the center panel, the cursor will select the table on the source system list.

  26. Multiple data sources: Clicking on a center panel’s data source alias icon and the ‘Load Now’ icon will load all of its mapped tables to the data warehouse.

  27. Multiple data sources: ‘Refresh Schedule’ button changed/renamed to ‘Refresh Batch’ icon.

  28. Multiple data sources: ‘Refresh Batch Now’ has been moved to the 'Refresh Batch' page.

  29. Multiple data sources: Ability to import data from the data warehouse for further data prep.

  30. Load UI: The load UI page is now integrated in the ETL+ application (not a detached layer).

  31. Load UI: The load UI page now has the Cancel button. In a multi-table load process, clicking Cancel stops the load process when the table currently loading ends.

  32. Load UI: For OData, it shows how many records have been extracted.

  33. Cloud Watchdog: Monitors ETL+ scheduled refresh logging in the cloud and notifies administrators:

    1. On error

    2. When a scheduled refresh doesn’t start

    3. When a scheduled refresh takes longer than expected

  34. Cloud Watchdog: Emails notifications when ETL+ Notification Email = Always Cloud (for cases when ETL+ has no access to its SMTP server - deployments with tight firewall rules).

  35. Settings: Creation of the Settings page and added its icon on ETL+ main page.

  36. Settings: Page provides access to ‘Client Info’, notification about ‘3 secs between error retries', ‘Debug’ drop down, ‘0_EntityID Column’, ‘Data Warehouse’ configuration, ‘About’, 'Notification Email’.

  37. Settings: Notification Email includes dropdown for:

    1. Default: ETL+ always sends notification email)

    2. On Error: ETL+ only sends email on error

    3. Always Cloud: Cloud Watchdog always sends notification

  38. Refresh Batch: Renaming Refresh Schedule to Refresh Batch, re-layout and clean up.

  39. Refresh Batch: Bottom left section shows WTS summary configuration.

  40. Refresh Batch: ‘WTS Settings’ button provides means to configure and apply WTS settings.

  41. Refresh Batch: Click a 'Refresh Now' icon on the batch list to run it.

  42. Refresh Batch: Add, Delete, Create Shortcut, and Enable became icons on the batch list.

  43. Refresh Batch: List of Refresh Batch Steps shows twice as much vertical real estate (lists twice as many objects).

  44. Refresh Batch: Refresh Batch Steps includes 3 new functions/scripts: ‘Tableau Extract Refresh', ‘Cloud Script’, 'Command Line’.

  45. Refresh Batch: Clearer description of ‘All Data Warehouse Tables (include new ones)’ checkbox.

  46. Refresh Batch: Click a step and ‘Move Up’ and/or ‘Move Down’ icons to re-order refresh sequence.

  47. Refresh Batch: Click ‘+' icon ('Add Script’), and select a script type to create.

  48. Refresh Batch: Select ‘Tableau Extract Refresh’ to configure an extract to be refreshed. These extracts must be hosted at https://dataselfbi.com and pull data from DataSelf's cloud data warehouses.

  49. Refresh Batch: ‘Tableau Extract Refresh’ script needs the extract name. If the extract is not in the default Project (named ETL+'s Entity ID), enter the ‘Project’ name. If the extract is in a sub project, enter the 'Parent Project' name.

  50. Refresh Batch: Select ‘Cloud Script’ to provide its name. Consult DataSelf to discuss your cloud script options (such as running other cloud ETL+ extractions, DataSelf Automatic Distribution, and Python custom applications).

  51. Refresh Batch: Select ‘Command Line’ to provide its name and parameters. This will run the configured command line locally. Example of use cases: running locally Tableau extract refreshes, or on-premises DataSelf Automatic Distribution.

  52. Refresh Batch: Select a script step, and click icons ‘Delete Script’, ‘Configure Script', or 'Run Script’ as needed.

  53. Refresh Batch: Other UI buttons/icons become disabled when editing scripts.

  54. Refresh Batch: Icons on the Steps panel differentiate objects between tables and scripts.

  55. Refresh Batch: Mousing over icons provide its function, name and/or metadata.

  56. Refresh Batch: ‘Run Refresh Batch’ has a simplified UI with a counter starting at 20 secs.

  57. Logging: ETL+ logs description and time for new functions/scripts (Tableau Extract Refresh, etc).

  58. Logging: When launching ETL+, the very first log is “ETL+ launched”.

  59. Engine: Notifies when ETL+ doesn’t find the required .NET installed (.NET v7 or newer).

  60. OData Extraction: When RWC or Update is configured, ETL+ will load in sets of up to 100 extraction blocks, execute the load of that set to the target table, and then run the next set of extraction blocks. This is helpful when extracting data from large tables. It helps Acumatica rendering speed, and provides intermediary starting points in case of failures or extraction quitting in the middle of the process.

  61. OBDC Extraction: Support to MongoDB ODBC. Use native MondoDB ' (single quote) or ANSI [] (brackets) around reserved words and nested collections.

  62. Improved error message description when ETL+ can’t connect to its data warehouse.

  63. Added error message describing that MS SQL doesn’t accept insert in timestamp columns.

  64. Super admin can now trigger the deployment of the out-of-the-box Tableau Site and Extract templates.

Resolved Issues

  1. Counter of Load UI page fixed (it was always counting 1 extra item).

  2. Handling of OData v4 having more than one table with the same name.

  3. Creation of EntityID now requires a unique ID.

Known Issues

  1. Changing the data warehouse of an entity won’t show on the bottom left corner until the entity is closed and re-opened.

...