Versions Compared

Old Version 33

changes.mady.by.user Joni Girardi

Saved on

compared with

New Version 34

changes.mady.by.user Joni Girardi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

2021.03.3102

...

***

...

LATEST RELEASE ***

Expand
titleDownload, Release Notes, Release Date

Release date: 03/31/2021

Download Files

64 bits: https://www.dataself.com/etl_plus/DataSelf ETL Plus 64 bits - Beta 2021.03.3103.exe

32 bits: https://www.dataself.com/etl_plus/DataSelf ETL Plus 32 bits - Beta 2021.03.3103.exe

New Features

  1. Integrated IP Whitelisting. If ETL+ can’t connect to DataSelf cloud servers, it whitelists the new IP once the user enters the correct product registration information.

  2. Friendlier installation. ETL+ is now an executable-only application. One just needs to download and run it. No installer, no changes to the Windows environment, no need to Run as Admin (unless in some systems when creating Windows Task Schedule tasks).

  3. ETL+ automatically sorts columns alphabetically when adding new source system tables.

  4. Enable SELECT * from MS SQL and OData data sources. Preview only works with MS SQL sources.

  5. OData extraction ignores duplicated column names (avoiding OData → SQL extraction errors).

  6. Refresh Schedule page: “All Tables” checkbox to include new tables added to the ETL process.

  7. Refresh Schedule page: “Tableau Subset” checkbox runs a dedicated Tableau refresh batch for the selected Refresh Schedule. Example: the default Refresh Schedule refreshes all Tableau extracts overnight, and a 2nd one refreshes a subset of Tableau extracts hourly. The creation of Tableau refresh batches continues to be a manual process done by DataSelf.

  8. Refresh Schedule page: “Create Shortcut” checkbox to create ETL+ auto refresh shortcuts.

  9. Refresh Schedule page set to 800x600 resolution.

  10. Refresh Schedule page lists Schedule ID (3rd parameter when running ETL+ via command line).

  11. Windows Task Scheduler: “Repeat tasks every” X minutes (ex.: run every 5 mins starting at 8am).

  12. Windows Task Scheduler: “For a duration of” X hours (ex.: run every 5 mins starting at 8am for 12 hours). To configure indefinite tasks, set duration to 24 hours.

  13. Windows Task Scheduler: Enable configuration of “Recurs every” X days (ex.: once a week).

  14. Windows Task Scheduler: Schedules tasks into the future (to prevent users from mistakenly configuring tasks in the past).

  15. Windows Task Scheduler: UI re-layout for better clarity and more real estate for configurations.

  16. Speed: “Update” delta refresh creates data warehouse indexes for the filter and index columns.

  17. Speed: “Replace with Control” delta refresh creates a data warehouse index for the filter column.

  18. SQL Integrity: “Update” delta refresh turns varchar(max) filter and index columns into char(50).

  19. SQL Integrity: “Replace with Control” delta refresh turns a varchar(max) filter column into char(50).

  20. When running ETL+ for the 1st time, the DataSelf cloud servers connection only happens after the user has accepted the EULA.

  21. If ETL+ can’t download the EULA: it’ll show the EULA page blank (probably an internet connection, firewall or antivirus issue).

  22. When ETL+ can’t connect to DataSelf cloud servers: shows error about IP whitelisting and/or firewall and antivirus adjustments. And then tries to whitelist IP (see feature 1 above).

  23. Super admin: Settings page to select, modify or new data warehouse and its SQL schema. Blank schema = EntityID. Enter the new name to change the schema. Ex.: dbo.

  24. Super admin: Data warehouse configuration page has a Multi-Tenant checkbox. Check it for Advanced Analytics data warehouses, and uncheck it for Enterprise Analytics.

  25. Super admin: Client Info page: “0_EntityID Column” checkbox to create this column.

  26. Super admin: ETL+ logging in the cloud.

  27. Super admin: ETL+ cloud auto refresh log includes EntityID, TableName, Begin Date/Time, End Date/Time, Rows Before, Rows Deleted, Rows Updated, Rows Kept, Rows Inserted, Rows After, Refresh Criteria, Result Type, ETL+ User, Refresh Schedule ID, Refresh Schedule Run ID, Windows Computer Name, Windows Username.

  28. Super admin: “Entity” box converts all characters to lower case.

  29. Super admin: Creation of new OData entities sets the OData extraction blocks to 1000 records and 100ms pause (instead of 0 recs and 0ms pause which causes issues).

  30. Super admin: Wider Entity ID column on the Entities page.

Resolved Issues

  1. Super admin: Issues when creating new entities.

  2. The 32-bit version wasn’t saving ODBC credentials.

Known Issues

  1. When configuring Acumatica OData delta refreshes, in the case that OData doesn’t render the indexes of a table (Acumatica bug?), you might get an “invalid type for an index” error message. To fix it, keep the delta configuration as is, change the “Load Type” to “Replace All”, do a table refresh, and switch back to delta refresh.

  2. Failing to entering correct credentials 5 times in a row closes ETL+ but allows immediate 5 new re-attempts. The correct process is to force a 5 minute wait after 5 failed attempts.

...

Expand
titleDownload, Release Notes, Release Date

Release date: 02/28/2021

Download Files

64 bits: https://www.dataself.com/etl_plus/DataSelf ETL Plus 64 bits - 2021.02.2803.exe

32 bits: https://www.dataself.com/etl_plus/DataSelf ETL Plus 32 bits - 2021.02.2803.exe

New Features

  1. Move Windows User variables to the Windows ProgramData area.

  2. Simplifies running ETL+ and its auto refresh processes regardless of Windows users.

  3. Collaboration: When a user is editing an ETL+ entity, other users can only log, view or copy its settings. To release editing to other users, Save the entity or close ETL+.

    Other users trying to edit it will receive the message: “username is currently editing this entity. You can only view it. To re-load the modified entity, exit and re-enter ETL.”

  4. Collaboration: When a user tries to edit ETL+ but the metadata has changed by another user, ETL+ gives the message: ETL+ metadata has changed. In order to edit your ETL+, please exit and re-enter to re-load your metadata.

  5. Allowing users to open more than one ETL+ at the same time.

  6. When running Refresh Schedules in parallel, log each of them on their own block (easier to read log file).

  7. Table Load Types in Refresh Schedules: Refresh Schedules can run the default table load type (Refresh All, Replace with Control, Update, Append), or force a "Replace All". This helpful when using delta refreshes on a frequent schedule, and then forcing a replace all on a less frequent schedule to capture old records that have been deleted or modified.

  8. ETL+ lets the same Refresh Schedule run in parallel, but might issue the error message: [DS ERROR : 0902] ETL+ cloud log conflict. Two or more ETL+ are running the same Refresh Schedule at the same time. The data refresh might be ok.

  9. ETL+ allows the refreshing of the same data warehouse table in parallel. Users need to understand the implications of using this feature since it can lead to data consistency issues. Ex.: it’s Ok to append different data sets in parallel, but a full refresh in parallel is likely not desirable.

  10. When editing ETL+, add an * to the Save button to indicate changes haven’t been saved yet. Clicking Save removes the * flag.

  11. Support to OData v4. First release. Test it before using it for production.

  12. Resized ETL+ UI to fit small resolutions down to 800x600.

  13. ETL+ UI can be switched between default size, full screen mode and minimized.

  14. New redesigned ETL+ metadata for better auto documentation, faster performance and reporting.

  15. Upgrade from prior ETL+ versions requires the re-creation of entities, users and statements.

  16. When refreshing tables on ETL+ UI, the refresh progress indicator shows the Refresh Schedule name at the top, the table counter and % progress inside of the circle, and the table being imported at the bottom.

  17. Show ETL version and 32/64bits on the main page.

  18. Ability to define MS SQL Server data warehouse’s database schema. The default schema = ETL+ EntityID. ETL+ admin users can set the schema to any other value (such as dbo). Multi-tenant data warehouses' ID=1 will always have schema = ETL+ EntityID.

  19. RWC and Update will do the first refresh in full refresh mode.

  20. Removed dozens of locally saved variables that are no longer used (they were used before metadata moved to the cloud).

  21. "Leave without saving?" when a user tries to close ETL+ without saving changes.

  22. For users with access to multiple entities, ETL+ remembers the last entity opened.

  23. Show ETL version and 32/64bits on the top right of main pages.

  24. Strong encryption of ProgramData info.

  25. Log changes to the source system’s connection string.

  26. Left and right trim to all user input fields (avoids spaces in usernames and passwords).

  27. ETL+ captures who saved an ETL SQL Statement version. Currently, only available in the ETL+ metadata.

  28. More informative error message when ETL+ cannot connect to its metadata or data warehouse.

  29. If two or more ETL try to refresh the same table at the same time, if the table has RWC or Update, it might give the error message: [DS ERROR : 0910] Two or more ETL+ tried to refresh the XYZ data warehouse table at the same time. This can cause data consistency issues. Please run a full refresh for this table again.

  30. ETL+ version number set to YYYY.MM.DDNN (NN is sequential starting on 01).

  31. ETL+ EULA and About pages inform the latest ETL+ version and URL for download (in case users are installing an older version accidentally).

Resolved Issues

  1. New features number 1 and 2 resolve several auto refresh friction points.

  2. Fixed data auto refresh not running from some servers via command line.

  3. Fixed a testing feature that prevented ETL+ from connecting to the cloud from some servers.

  4. Fixed the auto email of new product registrations.

  5. Fixed ETL+ Excel and CSV data sources to include headers on row 1.

  6. Fixed Update and Replace with Control refresh from ODBC sources.

  7. Fixed error message showing data warehouse structure names.

...