How to user pipeline parameters to change sink dataset paths in Synapse Analytics

Question

I've a Azure Synapse Pipeline that has some copy activities with parquets sinking datasets. My pipeline that runs the copy activities has a string date parameter. How to I pass this date parameters to the sink dataset and use it in the path of the blob as dynamic expression?

Answer 1

• If these multiple sink datasets are present in different activities of different pipelines, and you want to use the date 2022-12-01 for your path, then you can use global parameter.

• Since global parameter is a constant that can be used across multiple pipelines, it would fit the requirement.

• If these multiple sink activities are present in the same pipeline, then you can use the pipeline parameter itself.

• You can use string interpolation to include the parameter value wherever required. The following is a demonstration of the same:

• I passed the parameter value to dataset (through a parameter created in dataset called dt).

• Using the following dynamic content, I can create a folder with name as filename_2022-12-01

filename_@{dataset().dt}