Cross Compiled jar file with scala version : Spark

Question

I cant run my very first simple spark program with scala ide.

I checked all my properties and i believe that are correct.

this is the link with the properties.

any help ?

Answer 1

The problem is that you are trying to include Scala 2.11.8 as a dependency in your application, while Spark artifacts rely on Scala 2.10.

You have two options to solve your problem:

• Use Scala 2.10.x
• Use Spark artifacts that rely on Scala 2.11 (e.g. spark-core_2.11 instead of spark-core_2.10)