Search code examples
.nethadoophbasethrift

MapReduce on Hbase using Thrift in .NET?

Can i use Hadoop Streaming to Run MapReduce jobs on HBase using thrift in .NET? Or is there any other way to run MapReduce jobs on HBase from .NET?

Solution

  • I have successfully achieved this. So, the answer is yes it can be done.

    Edit

    I don't know why down votes, the question has the answer but following is how I achieved it:

    Thrift is more light weight than REST API and in some scenarios gives more performance than java api, I've used Hadoop Streaming API and give it my own Mapper implementation which uses Thrift to communicate with hbase e.g.

    bin/hadoop jar contrib/streaming/hadoop-*-streaming.jar -input input/sample.txt -output output -mapper input/StdInOut.exe -reducer NONE