libraryDependencies Spark in build.sbt error (IntelliJ)

Question

I am trying to learning Scala with Spark. I am following a tutorial but I am having an error, when I try to import the library dependencies of Spark:

libraryDependencies += "org.apache.spark" %% "spark-core" % "2.4.3"

I am getting the following error:

And I have 3 Unkwons artifacts.

What could be the problem here?

My code is so simple, it is just a Hello World.

What is your `scalaVersion`? – Luis Miguel Mejía Suárez Dec 12 '20 at 02:44 — Luis Miguel Mejía Suárez, Dec 12 '20 at 02:44

score 1 · Accepted Answer · answered Dec 12 '20 at 06:33

1

Probably you need to add to your build.sbt:

resolvers += "spark-core" at "https://mvnrepository.com/artifact/org.apache.spark/spark-core"

Please note that this library is supported only for Scala 2.11 and Scala 2.12.

answered Dec 12 '20 at 06:33

Tomer Shetah

8,413
7
27
35

2

Thank you so much! Was that, I was using Scala version 2.13, no need resolvers. – MLstudent Dec 12 '20 at 09:18

libraryDependencies Spark in build.sbt error (IntelliJ)

1 Answers1

Linked