Search code examples
apache-sparkapache-ranger

Spark table and Ranger Row filtering


Reading the docs we have the following doubt:

  • For a Spark table created by saveAsTable(...) and using the Hive metastore
    • can one use Apache Ranger to enforce row level filters on such a table?

It is not clear from the docs. For a 'native' Hive table it is clear that this is possible.


Solution

  • For Spark-only tables this is not possible. Confirmed with Ranger test.