DataSelf ETL+ Minimum System Requirements

v2023.10

Minimum Hardware and Software Requirements

• Hardware: 1 CPU core, 2GB of free RAM, 20GB of free disk space. A shared or dedicated VM/computer. Recommended monitor resolution: 1280x800 or higher. Reliable internet connection.

• Operating Systems: Windows Server 2012 R2 or 2016 or 2019 or 2022, or Windows 10 or 11. We recommend Windows Server for ETL+ scheduled tasks. .NET 4.7.2 or newer (usually included in the OS).

• Secured IP-to-IP connection: ETL+ whitelists your public IP address (https://dataself.atlassian.net/wiki/spaces/DS/pages/1574305793).

• Firewall: Many servers have outbound ports open and there’s no need to adjust the firewall. If ports are closed, please allow outbound communication with HTTP (port 80), HTTPS (port 443), SSL SQL connections (port 1433), and preferably SMTP protocol for refresh emails (port 587). We can provide you with our public IP addresses for your IP-to-IP whitelisting. Instead of the above, we can set up other methods such as a VPN to secure the connection.

• Antimalware: Be sure it doesn’t block DataSelf ETL+, DataSelf Agent, and the source database(s).

DataSelf Cloud Data Warehouses

Nothing else is required. DataSelf will securely host your data warehouse(s) in our AWS or Azure servers.

MS SQL Server for On-Premises/Private-Cloud Data Warehouses

Please use the following guidelines when hosting your data warehouse on your own MS SQL Server:

• Guidelines for hardware specs:

  • In most deployments, the data warehouse data space will be 1% to 20% of the source database data space (data space without logs).

  • For fast performance, allocate RAM for SQL to be at least twice as big as the largest table to be hosted in the data warehouse. For instance, allocate 16GB of RAM for SQL if the largest data warehouse table will have 8GB of data. With this spec, SQL won’t be forced to do HD swaps when working with this table. For top performance, all data space should fit into the available RAM.

  • Here are recommendations based on the expected data warehouse data space:

    • Up to 4GB: 2+ CPU threads, 2GB+ of RAM.

    • Up to 16GB: 4+ CPU threads, 8GB+ of RAM.

    • Up to 32GB: 4+ CPU threads, 16GB+ of RAM.

    • Up to 128GB: 8+ CPU threads, 64GB+ of RAM.

    • Above 128GB: contact us.

  • Disk space (SSD preferably): Minimum free 150GB. Make it 5+ times the expected data space.

• Windows Server 2022, 2019, or 2016.

• MS SQL Server versions: 2022, 2019, 2017, or 2016.

• MS SQL Editions: any.

• SQL Authentication supported: Windows, SQL, Azure AD - Password.

• Server or serverless architecture. Preferably on a dedicated server.

• Recovery model: Simple (or Full).

• Compatibility level: Latest available.

• Collation: the same as your source systems', if applicable. Our default is SQL_Latin1_General_CP1_CI_AS.

• ETL+ requires dbo role for the MS SQL database hosting the data warehouse.

• Recommended to set up SQL Encrypt connection and Trust server certificate, and its HD with encryption at rest.