Search code examples
hadoopmapreduceapache-pig

Renaming part files of PIG output

I have a requirement of changing the part file naming convention after running my PIG job. I want part-r-0000 to be userdefinedName-r-0000.

Any possible solution to that? I am avoiding hadoop -cp and hadoop -mv commands.

Thanks

Solution

  • This files are created by map-reduce jobs generated by Pig. So you should configure Apache Map-reduce. The corresponding property is mapreduce.output.basename

    You can define any Hadoop property directly in your pig script:

    SET mapreduce.output.basename 'custom-name';