DataSelf ETL+ Minimum System Requirements
Minimum Hardware and Software Requirements
Hardware: 1 CPU core, 2GB of free RAM, 20GB of free disk space. A shared or dedicated VM/computer. Recommended monitor resolution: 1280x800 or higher. Reliable internet connection.
Operating Systems: Windows Server 2012 R2 or 2016 or 2019 or 2022, or Windows 10 or 11. We recommend Windows Server for ETL+ scheduled tasks. .NET 4.6 or newer (usually included in the OS).
Secured IP-to-IP connection: ETL+ whitelists your public IP address. For more see ETL+ Public IP Whitelisting .
Firewall: Many servers have outbound ports open and there’s no need to adjust the firewall. If ports are closed, please allow outbound communication with HTTP (port 80), HTTPS (port 443), SSL SQL connections (port 1433), and optionally SMTP protocol for refresh emails (port 25). We can provide you with our public IP addresses for your IP-to-IP whitelisting. Instead of the above, we can set up other methods such as a VPN to secure the connection.
Windows credentials to run ETL+: 1) A standard Windows user can run ETL+ manually. 2) A user with local Windows Admin rights is required to run ETL+ scheduled data extractions.
User credentials to extract data from source systems: 1) Authentication: Windows or source database built-in authentication. 2) User with reading rights from source databases.
MS SQL Server for DataSelf Cloud Data Warehouses
Nothing else is required. DataSelf will securely host your data warehouse(s) in our AWS or Azure servers.
MS SQL Server for On-Premises/Private-Cloud Data Warehouses
Please use the following guidelines when hosting your data warehouse on your own MS SQL Server:
Guidelines for hardware specs:
In most deployments, the data warehouse data space will be 1% to 20% of the source database data space (data space without logs).
For fast performance, allocate RAM for SQL to be at least twice as big as the largest table to be hosted in the data warehouse. For instance, allocate 16GB of RAM for SQL if the largest data warehouse table will have 8GB of data. With this spec, SQL won’t be forced to do HD swaps when working with this table. For top performance, all data space should fit into the available RAM.
Here are recommendations based on the expected data warehouse data space:
Up to 4GB: 2+ CPU threads, 2GB+ of RAM.
Up to 16GB: 4+ CPU threads, 8GB+ of RAM.
Up to 32GB: 4+ CPU threads, 16GB+ of RAM.
Up to 128GB: 8+ CPU threads, 64GB+ of RAM.
Above 128GB: contact us.
Disk space (SSD preferably): Minimum free 150GB. Make it 5+ times the expected data space.
Windows Server 2022, 2019, or 2016.
MS SQL Server versions: 2022, 2019, 2017, or 2016.
MS SQL Editions: any.
Server or serverless architecture. Preferably on a dedicated server.
Recovery model: Simple.
Compatibility level: Latest available.
Collation: the same as your source systems', if applicable. Our default is SQL_Latin1_General_CP1_CI_AS.
ETL+ requires read/write roles for the MS SQL database hosting the data warehouse.