Search code examples
javahadoopmapreducehadoop2

How to add third party jar to mapreduce job?


Looking for the solution to add third party jar into mapreduce job. Currently, we are bundling third-party jar into map reduce job. Seems sometimes size of mapreduce job jar is going to high. is there another approach to overcome this problem


Solution

  • Generally going down the uber jar route is the is a good one, adding jars to the generic java classpath becomes problematic in the event you have dependencies on a different version of the same jar for different MapReduce jobs.