Search code examples
stringazureazure-data-factorytransformation

Modify output of an acitivity in Azure Data Factory

I want to do a simple string transformation on the output of an activity in Azure Data Factory. I can use a Databricks notebook of course for that, but I would like to have a simpler and lighter solution. Is there any built in activity in Azure Data Factory specifically for this purpose?

Solution

  • The output of an active can't be modified or changed directly.

    In Data Factory, if you want to achieve that, it will be complex. There isn't a simpler and lighter solution. Also, there isn't an exist built in activity in Azure Data Factory specifically for this purpose.

    The Data Factory workarounds would like this:

    1. Store the active output into a JSON file, then modify the JSON File through Data Flow. Some others have post the same question, you can search and found that. The step also is a little complex.

    2. Pass the output into parameter or variable with Set variable. Then use the expression language/function to modify the output. The expression may be complex too.