Search code examples
pythonapache-sparkpysparkjdbcapache-spark-sql

How to pass the date parameter in pyspark query using Jupyter notebook?


I want to pass the date parameter in below query in jupyter notebook but its not working as the way its mentioned below. Dont know where the problem is lying.

filedate = '2022-11-15'

query = """(select * from db.xyz
        where name = 'Tom'
        and login = '{filedate}') as salary"""

 df = spark.read.format("jdbc")\
                          .option("url", jdbc_url)\
                          .option("driver",jdbc_driver)\
                          .option("dbtable" ,query).load()

Solution

  • You are missing an f-string:

    filedate = '2022-11-15'
    
    query = f"""(select * from db.xyz
            where name = 'Tom'
            and login = '{filedate}') as salary"""