Search code examples
airflowproviderdirected-acyclic-graphsairflow-2.xmwaa

Newly installed Airflow providers don't show in Web UI


I'm using MWAA and when I add new providers via requirements.txt they do not show in the "Airflow - Admin > Providers" UI, while the default providers installed on the MWAA instance show just fine.

An example:

  1. I add apache-airflow-providers-databricks==2.0.2 to the requirements.txt
  2. upload it to the MWAA S3 bucket
  3. wait for the instance to reboot
  4. successfully run a test DAG to ensure the provider installed correctly.

Result: After all of that, this is the "Admin > Providers" tab:

enter image description here

I just want to be able to easily see all providers installed. Any advice is appreciated.


Solution

  • So it looks like this is actually an internal VPC issue. I didn't think this would be relevant at the time, but when I run a public (vs. private) instance I do not have the same issue.