Search code examples
google-cloud-platformairflowgoogle-cloud-composer

How can I pass the yes flag to backfill in Google Composer?


I am trying to do a backfill in Google Composer using a gcloud composer command but I am struggling to pass a -y or --yes for a corresponding --reset_dagruns argument.

The response I get is airflow: error: unrecognized arguments: -y.

Command:

gcloud composer environments run my_env --project my_project --location us-east1 backfill -- --reset_dagruns -y -s 2020-01-01 -e 2020-01-31 my_dag

How can I supply this argument?


Solution

  • In case anyone else has this issue, I was not able to find a way to pass in the argument using gcloud composer.

    Instead I used gcloud container clusters get-credentials to do a kubectl exec to get a bash prompt on the airflow scheduler. From there I was able to use the native airflow command to move things along.