Search code examples
airflowrequirements.txtmwaa

mwaa restart functionality for requirements.txt updates


Every time our team puts another requirements.txt file for our MWAA environment, it requires a restart.

Regardless of the environment being in a PENDING or UPDATING state, I can still access the UI and run/monitor DAGS. I expect something to at least be unavailable or locked during this process from a user perspective.

So, my questions are: in the MWAA way of things, what exactly is being "restarted" during this process and why is applied to the entire so-called MWAA environment?


Solution

  • Airflow DAG processor, Airflow workers and Airflow scheduler are reboot but not Airflow web server This can be confirmed checking their respective logs.

    Beware, some long-running task can fail during a reboot.