Search code examples
hadoophive

Maximum number of databases and tables in Hive Metastore

Inspired by a formerly asked question: Maximum number of partitions in hive

I would like to know if there is also maximum number for items below:

  1. Maximum number of databases in a catalog (I assume Hive Metastore only has one catalog, which is "hive")
  2. Maximum number of tables per database (as in, can I create 10 million tables in a database or due to limitation must I split them into 10 databases each with 1 million tables)

I also would like to know whether the limitations are hard limit (unconfigurable), or configurable by Hive, or dependent on RDBMS it is using.

UPDATE: Crossposted to Cloudera Community after 7 days of inactivity. I will be active on both places.

Solution

  • Answered in Cloudera Community by ChethanYM

    Key Summary:

    • No hard limits on database and tables
    • Expect performance issues if total number of objects exceeds 500,000 (defined as "objects like tables and partitions in the warehouse including column and column type information etc...")