Search code examples
sql-serverazureazure-sql-databasedata-warehouseazure-data-factory

Stream Data from SQL Server into Azure Data Warehouse

The Microsoft process looks like a batch import method of copying data from SQL Server into Azure Data Warehouse.

enter image description here

Is there a simpler method, conducting every second of streaming data from MS SQL Server into Datawarehouse. This seems overly complicated with two ETL steps, (Azure Data Factory, and then Polybase) . Can we continually stream data from SQL Server into Data Warehouse? (We know AWS allows streaming of data from SQL server into Redshift DW). Stream Data from SQL Server into Redshift

https://azure.microsoft.com/en-us/services/sql-data-warehouse/

Solution

  • Your link does not explain how to stream data from SQL Server to Redshift; rather it suggests a data migration service for continually ETL'ing data from source to destination. If this is your aim, your can write an SSIS package (i.e. migration service) and schedule it on a continuing basis using Azure Data Factory.