Search code examples
azureazure-functionsazure-data-factory

how to parameterize query timeout in Copy data activity for full load and incremental load in azure data factory

In copy data I have query timeout as 2hrs I want to parameterize the query timeout for Full load and Delta load.

For Full load query timeout should be 2 hrs For delta load query timeout should be 45mins

Solution

    • You can achieve your requirement through either of the two following. You need to have a condition to check whether the load is full or incremental.

    • Now you can use if condition activity to check this. You can use dynamic content to select the value for query timeout directly in the copy data activity.

    • The following is an example how you can achieve this. I have a parameter with its value as full or incremental. enter image description here

    • Now use dynamic content with condition something similar to @{if(equals(pipeline().parameters.load,'full'),120,45)}

    enter image description here

    • For this to work, you need to know what the particular load would be before executing the copy data activity.