Hadoop job error in dataproc gui version on Google cloud

Question

I am trying to create a job for wordcount using org.apache.hadoop.examples.WordCount but it shows errors:

I am attaching images of my job configuration and also where are the files located in my bucket(I am using buckets and not hdfs)

Job configuration used:

Files are stored in bucket:

URI for hadoop-mapreduce-examples.jar:

The error i got when I used above configurations:

The job output: The driver outputfile:

Answer 1

The problem is that by default Hadoop won't write to an existing path, unless an "overwrite" mode has been specifically asked for. You have two options:

• Delete the output path before running the example
• Use another output path for each run

In general, the output of the job can be found in the Google Cloud console - look for the "Jobs" page under Dataproc, or for the Jobs tab under the cluster page. Also, as presented here, the output is saved to GCS and you can always retrieve it from there.