Search code examples
azure-data-factoryazure-storage-account

Azure Data Factory "Name File as column data" option in Sink transformation of data flow is creating blobs name for virtual folder

I have create and ADF pipeline. Source and sink, both are storage account. I want to create file based on date in column data, so I selected the option "File Name as Column Data". In this option, we are giving filename, with virtual folder path.

But when process is completed, blob(hot inferred) also created for virtual folder, which I don't need. I just need blob for files(which is also present). If I delete those virtual folder blobs, I cant put the file in incremental way in those folder.

What should I do?

Solution

  • You should set the column format first in source projection before set "File Name as Column Data".

    Here's my source file:

    enter image description here

    Source projection settings: specify the column date type and format.

    enter image description here

    Sink settings:

    enter image description here

    Output: enter image description here

    Then we can get the output files without the virtual folder.

    HTH.