Search code examples
python-3.xairflowpipeline

Airflow pipeline is not triggered

Actually I've defined a pipeline start date from 12 Dec 2021. This is same as 4 am Singapore time on 13 Dec 2021. As by default the pipeline is in utc, I've set it to 8 pm utc i.e., 4 am sgt The pipeline seems to not trigger at 4 am singapore time,, I don't under stand why the pipeline is not triggered? Below is the dag config

dag = DAG(
    'test',
    start_date=datetime.datetime(year=2021,month=12,day=12),
    schedule_interval='0 20 * * *'
)
Solution

  • Try changing the start date to a few days back, and it will get triggered.

    The reason is that the start_date specifies the first date and time for which you want to have data in a database. Airflow will run a job at start_date + interval, so after the interval has passed (because that’s when data becomes available). You can read more about it here and here.