Search code examples
apache-spark-sqlorc

Exploding array of struct, spark-sql returns null for orc file format


I've external table which stores the data in ORC file format. When I'm trying to explode the array<struct> field from the table it returns the null value


Solution

  • spark.sql.hive.convertMetastoreOrc=false

    Works for me

    https://spark.apache.org/docs/latest/configuration.html