airflow on kubernetes: how to load dag files from local filesystem?

Question

i want to install airflow for my k8s cluster. I tried to use the bitnami repo but i want to know how to load dag files from my local filesystem.

Answer 1

One solution we implement is

• Keep the dags,sqls,utils,plugins in github(or any other repo)
• If you are using k8s using AWS then Use EFS(shared file system).
• you can check https://github.com/kubernetes-retired/external-storage/tree/master/aws/efs
• Then you need to mount the efs volume for your scheduler and webserver as readonly option.

This is our preferred approach.