I am trying to do a backfill in Google Composer using a gcloud composer
command but I am struggling to pass a -y
or --yes
for a corresponding --reset_dagruns
argument.
The response I get is airflow: error: unrecognized arguments: -y
.
Command:
gcloud composer environments run my_env --project my_project --location us-east1 backfill -- --reset_dagruns -y -s 2020-01-01 -e 2020-01-31 my_dag
How can I supply this argument?
In case anyone else has this issue, I was not able to find a way to pass in the argument using gcloud composer
.
Instead I used gcloud container clusters get-credentials
to do a kubectl exec
to get a bash prompt on the airflow scheduler. From there I was able to use the native airflow command to move things along.