Search code examples
hadoopmapreducebigdataavro

how to pass in multiple input directories for Avro MapRedcue Job


I could process multiple .avro files using comma ',' separation but not folders. I need to process multiple folders/subfolders using AvroMapReduce. Please let me know how I could resolve this issue.


Solution

  • This variant works for me:

    /{dir1/subdir1,dir2/subdir2,dir3/subdir3}