Search code examples
hbasebulk-loadhfile

Mapr-Db bulkloading is failing at reducer end


Bulkload failed while processing the reducer with following error. We are running the mapreduce on M5 cluster trying to update a m7 table.

java.io.IOException: bulkLoaderClose() on '/home/test/account122' failed
with error: Function not implemented (38). 
at com.mapr.fs.Inode.checkError(Inode.java:1611) 
at com.mapr.fs.Inode.checkError(Inode.java:1583) 
at com.mapr.fs.Inode.bulkLoaderClose(Inode.java:1278) 
at com.mapr.fs.MapRHTable.bulkLoaderClose(MapRHTable.java:119) 
at com.mapr.fs.hbase.BulkLoadRecordWriter.close(BulkLoadRecordWriter.java:160)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:621)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:458)
at org.apache.hadoop.mapred.Child$4.run(Child.java:278)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566) at org.apache.hadoop.mapred.Child.main(Child.java:267)

hbase version is 0.98.12-mapr-1506.

The Mapr-Db table is enabled for bulkloading. Reducers process all the data and at the time of bulkload it fails some how.

Please help.


Solution

  • By default the MaprdDb tables do not support BulkLoading. The error Function not implemented (38) indicates that this feature is not supported.