Search code examples
javahadoopmapreducehdfshadoop-yarn

what difference between execute a map-reduce job using hadoop and java command


Find many option for run a map-reduce program. Can any one explain difference between theses below commands. And what impact on Map-reduce job if any.

     java -jar MyMapReduce.jar [args] 

     hadoop jar MyMapReduce.jar [args] 

     yarn jar MyMapReduce.jar [args] 

In these command which one best or other in any?

Can make configuration like display all information about job using Yarn and Job History (like as display Hadoop and yarn command) on Web service normal using port for web service 8088(YARN) on below command?

     java -jar MyMapReduce.jar [args] 

Solution

  • None of them is better than the other. When you execute the java -jar command, it is just the same as executing a non Hadoop application. If you use hadoop jar or yarn jar, it will use the /usr/bin/hadoop and /usr/bin/yarn scripts to set up the environment.

    Unless you have modified any of the scripts to set up additional variables, the three of them should work the same.