Cross Compiled jar file with scala version : Spark

Question

I cant run my very first simple spark program with scala ide.

I checked all my properties and i believe that are correct.

this is the link with the properties.

any help ?

In your case, Spark artifacts use Scala 2.10 and you are trying to include Scala 2.11.8 as a dependency to your app. What if you try to use Scala 2.10.x instead? — Anton Okolnychyi, Dec 07 '16 at 10:32
@AntonOkolnychyi You are 100% correct, please write an answer :) — T. Gawęda, Dec 07 '16 at 10:41

score 3 · Accepted Answer · answered Dec 07 '16 at 10:49

3

The problem is that you are trying to include Scala 2.11.8 as a dependency in your application, while Spark artifacts rely on Scala 2.10.

You have two options to solve your problem:

Use Scala 2.10.x
Use Spark artifacts that rely on Scala 2.11 (e.g. spark-core_2.11 instead of spark-core_2.10)

answered Dec 07 '16 at 10:49

Anton Okolnychyi

1

Spark, starting from 2.0, uses Scala 2.11 as default Scala version. I highly recommend upgrading Spark version – T. Gawęda Dec 07 '16 at 10:53
1

@T.Gawęda yep, I completely agree. – Anton Okolnychyi Dec 07 '16 at 10:55
Thank you Sir! i used 2.10.x version ! and i changed the container of the scala library. – Panos Dec 07 '16 at 13:54

1 Answers1