Search code examples
scalahadoopscalding

scala filename too long


I'm using scala 2.10 and gradle 1.11

My problem is that the compiled jar drop an error when I try to running in the hadoop cluster. I want to run on hadoop because I using scalding.

The exception is:

Exception in thread "main" java.io.FileNotFoundException:
/tmp/hadoop-root/hadoop-unjar6538587701808097105/com/twitter/bijec
tion/GeneratedTupleCollectionInjections$$anon$31$$anonfun$invert$10$$anon
fun$apply$46$$anonfun$apply$47$$anonfun$apply$48$$anonfun$apply$49$$anonfu
n$apply$50$$anonfun$apply$51$$anonfun$apply$52$$anonfun$apply$53$$anonfun$app
ly$54$$anonfun$apply$55.class (File name too long)

Any comments are welcome...


Solution

  • Adding -Xmax-classfile-name 200 to the scalac options should fix that.

    Sources:

    https://issues.scala-lang.org/browse/SI-3623

    https://groups.google.com/forum/#!topic/simple-build-tool/wtD6vgdiy6g