Search code examples
jsonazure-data-lakeazure-data-factory

Transfer the output of 'Set Variable' activity into a json file [Azure Data Factory]

In Data Factory, can we have the output from 'Set Variable' activity being logged as a json file?

Solution

  • No built-in easy way for your need as i know.

    2 ways as workarounds:

    1.Use enable Azure Monitor diagnostic log in ADF to log data into Azure Blob Storage as JSON files.And every activity's execution details(contains output) could be logged in the file.However,you need to get know the structure of json schema and grab what you want.

    2.Use Azure Function or Web Activity after Set Variable Activity to call API(@activity('Set Variable1').output). Save the output into residence as json file in the function method with SDK code.