Search code examples
hadoophiveimpala

hive/impala metadata refresh


Does REFRESH table command refresh the metadata in Impala when a partition location is changed in Hive?

I am changing the Hive table partition location using

ALTER TABLE db.table partition(key=value1, key2=value2) set location='path'

After that, I am running REFRESH db.table in Impala which is not updating metadata. If I run INVALIDATE METADATA it is working.


Solution

  • There is Impala JIRA-4364 open for that. However its been in product backlog since 2017, so currently INVALIDATE METADATA is the only workaround.

    UPDATE: This has been fixed in Impala 4.0 (see same JIRA link above).