Search code examples
command-line-interfaceooziehadoop2

What are the different ways of submitting Hadoop jobs?

I just know the below two ways of submitting Hadoop jobs

1) CLI(Command line interface)

2) OOzie

Are there any other ways to do it ? and which is the most widely used method of submitting the Hadoop jobs?

Solution

  • What does Hadoop jobs mean ?

    MapReduce : CLI + Oozie

    Spark : spark-shell + Java / Pyton / Scala + Spark Job Server (Rest) + Oozie

    Hive : CLI + Java - Thrift(JDBC) + Oozie

    Pig : CLI + Java + Oozie

    etc ....... If you want to use all of these you can use Hue. If you want to schedule all of these you can use Oozie.