Search code examples
pythonapache-sparksqlalchemypyspark

Is there a way to connecto Spark-Sql with sqlalchemy

Is there a way to connect Spark-Sql with sqlalchemy I have legacy code that uses sqlalchemy How could i make it use spark-sql ,can i make sqlalchemy as the translation layer to spark-sql ?

Solution

  • yes , look at this project https://github.com/dropbox/PyHive

    There are some adjustments you will need to do , fortunately SQLAlchemy is build for that