Search code examples
azureazure-data-factoryazure-blob-storage

Extra Files (Block Blobs) creating in the copy activity of the Blob Storage in ADF

I have followed the solution given in this thread, copying data is successful but I'm getting the folder names as block blobs which are extra files to the destination storage account:

Source Storage container data: enter image description here

After copying, target storage container containing the extra block blob files as shown below:

enter image description here

Why those extra files are creating and any mistake in the solution I followed:

Whole Pipeline: enter image description here

Step 1: Get Metadata activity

enter image description here

enter image description here

Step 2: For each Activity: enter image description here

Copy Activity inside for each activity:

enter image description here

enter image description here

enter image description here enter image description here

Solution

  • Thank you, @Jashua Criss, posting our discussion as the answer for the community.

    To achieve your requirement, you need to make sure both source and target storage accounts are same which either ADLS2 or GPv2. Also, the use ADLS gen2 linked services for both source and target.

    enter image description here

    Results in one container:

    enter image description here