Search code examples
pythonamazon-web-servicesboto3amazon-athenapyathena

Which one is faster for querying Athena: pyathena or boto3?


Which one is faster pyathena or boto3 to query AWS Athena schemas using python script?

Currently I am using pyathena to query Athena schemas but it's quite slow and I know there is another option of boto3 but before starting need some experts advice.


Solution

  • Looking at the dependencies for PyAthena you can see that it actually have a dependency of boto3.

    Unless PyAthena has added a lot of overhead to its library which is unlikely, the best performance improvements you're likely to see will depend on how you're using Athena itself.

    There are many performance improvements you can make, Amazon published a blog named Top 10 Performance Tuning Tips for Amazon Athena which will help to improve the performance of your queries.