Search code examples
rsparklyr

Disable hive support in sparklyr

Is there any way to disable the hive support in sparklyr?

Just like in SparkR:

sparkR.session(master="local[*]", enableHiveSupport=FALSE)
Solution

  • That option was introduced in sparklyr 1.3.0 after breaking Ron's answer solution on version 1.2.0 as described on issue #2460.

    library(sparklyr)

config <- spark_config()
config$sparklyr.connect.enablehivesupport <- FALSE

sc <- spark_connect(master = "local", config = config)