Manually refreshing data from the main page
...
You can view the activity log by clicking on the notebook icon in the upper right corner of the ETL+ app
...
...
Also see this link in the ETL+ User Guide: ETL+ Logging - DataSelf - Confluence (atlassian.net)
Scheduled Refresh Batch/Job
Also see this link in the ETL+ User GuideRelated articles: ETL+ Refresh Batch Page - DataSelf - Confluence (atlassian.netJob Page (dataself.com)
ETL+ enables you to schedule automated refreshes using the Refresh Batch function. The icon is different on versions of ETL+. And the options to run the refresh are different on newer versions. But the procedure to schedule a refresh remains same. We will use v2202.0208.0505 2901 for our training example.
Note: , The assumption is that whoever installed and configured ETL+ in your organization already set up the Refresh Batches and the schedule for running the processes. This focus is on how to maintain the Refresh batches when you add a new table.
...
When you click on the Refresh Batch/Job icon a new screen displays
...
The left panel lists one or more scheduling groups, called batches or jobs. The typical configuration includes two refresh jobs, but this is not required. You might configure the 1st job to refresh only SQL data warehouse tables and the 2nd job to refresh only Tableau data sources. Or you might configure the 2nd job to refresh specific tables in addition to the 1st job refresh.
The right panel lists all the data sources tables in the data warehouse, with a . A check mark on indicates the ones tables that will get processed in this batch/refresh job.
In the example above you notice not all the checkboxes are marked. The unmarked ones will not be refreshed in this batch, job but might be marked to refresh in a different batchjob. Each batch job can be run at different times and different frequency. See on the lower left panel the start date, time, and frequency for batch Job 1.
There are two types of data to refresh; : SQL data warehouse tables , and Tableau data sources.
In the example below, the blue snowflake icons represent Tableau data source refreshes. These Tableau Data Sources were previously created with DataSelf Desktop. These refresh scripts run the original refresh process stored on the Tableau server. In this example none of the Tableau refreshes are checked, which means none of them will be refreshed in this batch. In real life you would validate that they are being refreshed in one of the other batches, or that there is a reason for them not being refreshed.
The last record in the right panel is the newly created APContact SQL data warehouse table.
ETL+ adds new records to the end. You can manually re-arrange them as you desire.
...
This version 2202.02.0505 uses the Window Note, the ETL+ refresh processes in the order the files are listed on the right side. In the example below, the APContact SQL table refreshes last, but the refresh for the Tableau APContact data source is further up the list, so it runs before the SQL data is refreshed. This could be a problem.
...
Starting with version 2202.08.2901, you can use either the DataSelf ETL+ Agent Scheduler or the Windows Task Scheduler (WTS) on the PC machine where ETL+ is installed to run the refresh processes. Newer versions of ETL+ include the option of using DataSelf’s Scheduling Agent, which has more features available. The result is the same for both methodsThe ETL+ Agent enables remote editing of the refresh schedule. WTS (Windows Task Scheduler) requires a person be locally connected to the server running the Windows Task Scheduler app.
To see the configuration, highlight the selected job and click on the Properties (Wrench) icon.
...
In the example below, we added a new SQL data warehouse table, APContact. Now we want to mark it checked to include it on the schedule. Whether you add it to batch 1 or 2 is up to your organization's strategy for creating multiple refresh batches.
...