Search code examples
apache-sparktemp-tablesglobal-temp-tables

Difference between createTempview and createGlobaltempview and CreateorReplaceTempview in spark 2.1?

What is the difference between createTempview and createGlobaltempview and CreateorReplaceTempview in spark 2.1 ??

Solution

  • Global Temporary View

    As per documentation, global temporary view are views that are shared among all the sessions, untill all the Spark Application terminates.

    createorReplaceTempview

    createTempView (or more appropriately createOrReplaceTempView) has been introduced in Spark 2.0 to replace registerTempTable, which has been deprecated in 2.0. createTempView creates an in memory reference to the Dataframe in use. The lifetime for this is tied to the spark session in which the Dataframe was created in