Is there a way to schedule a Data Factory trigger that runs multiple times everyday BUT ONLY DURING A SPECIFIC TIME FRAME?

Question

I've created a pipeline with a web activity that uses REST API calls to my Synapse instance and pauses it at the end of every day. I'm trying to schedule it in Data Factory but the problem is I can't schedule it in the way I need. I want the pipeline to be triggered every hour but only between 6 PM and 10 PM everyday.

But ADF doesn't seem to provide this facility where a pipeline could be run only between a fixed timeframe every single day. I don't want my Synapse instance to be paused every hour during the day time.

Is there a way to bypass this limitation of Azure Data Factory scheduling?

Answer 1

You can using Azure logic app Recurrence trigger to achieve that:

Create a Recurrence trigger to call the data factory pipeline run with Get a pipeline run action.

Trigger the pipeline runs in [18,19,20,21,22](6 PM~10 PM) clock every day.

Hope this helps.