Search code examples
hadoophiveteradatahcatalog

Connecting HDP from Teradata Studio Express 15.10


I've been trying to connect my HDP cluster(2.1) from Teradata Studio Express 15.10 via Knox but couldn't succeed. All the configurations namely the JDBC hostname, port, user/password, WebHCat host,port I'm providing as correct. The JDBC connection is working perfectly if I test it from the beeline shell.

beeline> !connect jdbc:hive2://xx.xx.xxx.xxx:10000
scan complete in 11ms
Connecting to jdbc:hive2://xx.xx.xxx.xxx:10000
Enter username for jdbc:hive2://xx.xx.xxx.xxx:10000: hive
Enter password for jdbc:hive2://xx.xx.xxx.xxx:10000: ****
Connected to: Apache Hive (version 0.13.0.2.1.2.2-516)
Driver: Hive JDBC (version 0.13.0.2.1.2.2-516)
Transaction isolation: TRANSACTION_REPEATABLE_READ

However I don't find my conviction on WebHCat username it's asking of. Not sure what's the default one for HDP or how a new one could be defined. The custom webhcat-site.xml properties "webhcat.proxyuser.hue.groups" & "webhcat.proxyuser.hue.hosts" won't help me out here.

When I try the connectivity from Teradata Studio Express GUI, it gives the following error:

java.lang.Exception: Could not establish connection to jdbc:hive2://xx.xx.xxx.xxx:10000/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice: org.apache.http.conn.HttpHostConnectException: Connection to http://xx.xx.xxx.xxx:10000 refused
    at com.teradata.datatools.hadoop.hive.connectivity.HiveConnection.openJdbcConnection(HiveConnection.java:286)
    at com.teradata.datatools.hadoop.hive.connectivity.HiveConnection.createConnection(HiveConnection.java:199)
    at org.eclipse.datatools.connectivity.DriverConnectionBase.internalCreateConnection(DriverConnectionBase.java:105)
    at org.eclipse.datatools.connectivity.DriverConnectionBase.open(DriverConnectionBase.java:54)
    at com.teradata.datatools.hadoop.hive.connectivity.HiveConnection.open(HiveConnection.java:144)
    at com.teradata.datatools.hadoop.hive.connectivity.HivePingFactory.createJdbcConnection(HivePingFactory.java:44)
    at com.teradata.datatools.hadoop.hive.connectivity.PingJdbcJob.createTestConnection(PingJdbcJob.java:30)
    at com.teradata.datatools.hadoop.hive.connectivity.PingJob.run(PingJob.java:42)
    at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)

Anybody got any idea on what's happening here? Any pointers would be appreciated.


Solution

  • Got this issue resolved.

    There were couple of configs that were needed to be taken care of within TD Studio Express 15.10:

    For JDBC:

    Hostname, Port Number (10000 or 10001 or any other on which the hive service is listening), JDBC User Name, JDBC Password & uncheck "HTTP Transport Mode" from the options list in the tool.
    

    For WebHCat:

    WebHCat Hostname, Port Number(50111 or the one on which HCat is listening) & WebHCat User Name (hue)
    

    Lastly, the firewall configurations should be such that it won't be blocking the HCat port.