Assume that I want to write a table by writeStream
. Where is the default location on DBFS where the table is saved?
Sample code:
spark.table("TEMP_SILVER").writeStream
.option("checkpointLocation", "dbfs:/user/[email protected]")
.trigger(availableNow=True)
.table("silver")
If you specify just silver in table
method, then you should look for you table in following location:
dbfs:/user/hive/warehouse/silver