AWS Data pipeline documentation provides following information on pricing for data pipelines.
High frequency activities - $1.00 per month Low frequency activities - $0.60 per month Inactive pipelines - $1.00 per month
High Frequency activities are ones scheduled to execute more than once a day; for example, an activity scheduled to execute every hour or every 12 hours is High Frequency. Low Frequency activities are ones scheduled to execute one time a day or less. Inactive pipelines are those in PENDING, INACTIVE, and FINISHED states.
I have run into the following problem. Suppose I configure an on-demand data pipeline with a single activity. I am repeatedly activating this on-demand pipeline with a different configuration ( ex - different query in each run ) - say 100 times per day.
Does this count as a single high frequency activity, despite being activated multiple times?
Is the cost for activating this pipeline 100 times per day still $1 per month ?
Yes. Whether you are running the same activity multiple times or multiple activities one time/day, it is considered as high frequency.
Don't forget the instance costs that are associated with the pipeline.