Search code examples
hadoopmapreducehadoop-yarn

Run the TraceBuilder for converting JobHistory file


I am trying to convert jobhistory file with Hadoop tool Rumen for my YARN SLS learning. I cannot run the tracebuilder command. I found nothing for the problem on internet. I found nothing for this problem on internet. I want to know how to solve it, thank you. There are INFOs:

$ hadoop rumentrace 
java.lang.ArrayIndexOutOfBoundsException: 0
    at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.<init>(TraceBuilder.java:77)
    at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:206)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
    at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:186

Solution

  • It appears the command is trying to parse cli options, and you gave it none

    It requires at least 3 args

    hadoop rumentrace [options] <jobtrace-output> <topology-output> <inputs>
    

    https://hadoop.apache.org/docs/stable/hadoop-rumen/Rumen.html