Search code examples
djangocelerydjango-celerydotenvdjango-anymail

Using environment variables from .env in Django Celery

I'm using Django 2.x and Celery 4.3.x

In my Django application, I'm using dotenv to serve environment variable from .env file and to load the environment variable, I have following script in the manage.py and wsgy.py files

env_file = os.path.join(os.path.dirname(os.path.realpath(__file__)), '.env')
dotenv.read_dotenv(env_file)

The environment variables have AWS credentials being used by anymail plugin to send mail using SES.

Now, I'm using a Celery task to send the email and running the celery worker from the command line using

celery -A myapp worker -l debug

The worker is running but when sending an email, it gives an error in the celery task as

ERROR/ForkPoolWorker-2] An error occurred (AccessDenied) when calling 
the SendRawEmail operation: User `arn:aws:iam::user_id:user/my-laptop` is not 
authorized to permorm this action...

It seems trying to connect with my laptop's user instead of using the credentials defined in the .env file.

How can I use the .env file to server the environment files to the Celery worker?

Solution

  • Solved by loading the environment variable in the celery config file

    celery.py

    env_file = os.path.join(os.path.dirname(os.path.dirname(os.path.realpath(__file__))), '.env')
dotenv.read_dotenv(env_file)