Search code examples
hadoopapache-drill

HbaseStorageHandler plugin in Drill


I am able to query hive,hbase individually by using Drill.Now i am trying to query HbaseStorageHandler type tables in hive. For this in Drill, Hive Storage Plugin I added these properties as,

{
  "type": "hive",
  "enabled": true,
  "configProps": {
    "hive.metastore.uris": "thrift://trinitybdClusterM02.trinitymobility.local:9083",
    "javax.jdo.option.ConnectionURL": "jdbc:mysql://localhost:3306/metastore?createDatabaseIfNotExist=true",
    "hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
    "fs.default.name": "hdfs://trinitybdClusterM02.trinitymobility.local:9000",
    "hive.metastore.sasl.enabled": "false",
    "hbase.zookeeper.quorum": "localhost",
    "hbase.zookeeper.property.clientPort": "2181"
  }
}

I tried to query like,

0: jdbc:drill:zk=localhost> use hive.test; 0: jdbc:drill:zk=localhost> select * from twitter_test_nlp limit 1;

It is giving error as,

Error: SYSTEM ERROR: NoSuchMethodError: org.apache.hadoop.hbase.client.Scan.setAttribute(Ljava/lang/String;[B)V

Fragment 0:0

[Error Id: fc3994f4-7d7e-475e-870b-259ac91ea81a on trinitybdClusterM02.trinitymobility.local:31010] (state=,code=0)

Anybody is using this type please share me what properties I have to add for query HBaseStorageHandler tables of Hive.


Solution

  • In drill 1.9 this problem has resolved. drill 1.9 directly supports HbaseStorageHandler tables(Hive and hbase integrated tables) also with hive storage plug-in.And it directly supports spatial queries also like st_contains() etc.So if anybody need these type of requirements use drill 1.9.0.