Search code examples
pythonamazon-web-servicesscikit-learnaws-lambda

Using sklearn and pandas in AWS Lambda Layer


I was able to successfully follow this tutorial here to zip a scikit-learn package and create a layer. Now I have two layers loaded, one for scikit-learn and one for numpy and scipy that AWS already has. You can see that below

enter image description here

When I try to run my lambda now, I get an error that states that

"errorMessage": "Unable to import module 'lambda_function': No module named 'pandas'"

Thus I tried to do the same process with zipping up a pandas file together but when I try to load it, I exceed that 50mb maximum. Is there anyway of loading in pandas and sklearn together so that I do not go above this maximum limit?


Solution

  • You can use docker container as Lambda images. This will allow you to use way bigger libraries.