Search code examples
azureazure-data-factorydataflow

Mapping data flows, schema for parametrised sink and source

I am currently trying to rewrite some of my SSIS packages to ADF mapping data flows. I want to use parameters in order to avoid creating hundreds of different sinks and sources. However, I have encountered one problem on the way.

Let's take one sink as an example: enter image description here

enter image description here

It doesn't have any schema defined. Then if I try to use it in my dataflow(and provide a value for my parameter), I get:

enter image description here

I can avoid this error by hardcoding schema on my sink but then this schema is used wherever I decide to use this sink, so I cannot really use it mutiple times...

Thank you for any advice!

Solution

  • If are attempting to maximize reuse of a single data flow, you should consider just using auto-mapping for the sink and set "allow schema drift" to on so that you can gain maximum flexibility in your mappings.