Search code examples
azureazure-storageazure-data-lakedata-lake

Azure Lake to Lake transfer of files


My company has two Azure environments. The first one was a temporary environment and is being re-purposed / decommissioned / I'm not sure. All I know is I need to get files from one Data Lake on one environment, to a DataLake on another. I've looked at adlcopy and azcopy and neither seem like they will do what I need done. Has anyone encountered this before and if so, what did you use to solve it?


Solution

  • Maybe you can think about Azure Data Factory, it can helps you transfer files or data from one Azure Data Lake to Another Data Lake.

    You can reference Copy data to or from Azure Data Lake Storage Gen2 using Azure Data Factory.

    This article outlines how to use Copy Activity in Azure Data Factory to copy data to and from Data Lake Storage Gen2. It builds on the Copy Activity overview article that presents a general overview of Copy Activity.

    For example, you can learn from this tutorial: Quickstart: Use the Copy Data tool to copy data.

    In this quickstart, you use the Azure portal to create a data factory. Then, you use the Copy Data tool to create a pipeline that copies data from a folder in Azure Blob storage to another folder.

    Hope this helps.