scalaapache-sparkintellij-ideasbtintellij-scala
libraryDependencies Spark in build.sbt error (IntelliJ)
I am trying to learning Scala with Spark. I am following a tutorial but I am having an error, when I try to import the library dependencies of Spark:
libraryDependencies += "org.apache.spark" %% "spark-core" % "2.4.3"
I am getting the following error:
And I have 3 Unkwons artifacts.
What could be the problem here?
My code is so simple, it is just a Hello World.
Solution
Probably you need to add to your build.sbt:
resolvers += "spark-core" at "https://mvnrepository.com/artifact/org.apache.spark/spark-core"
Please note that this library is supported only for Scala 2.11 and Scala 2.12.
- How to read the json file in spark using scala?
- How to add self-signed generated certificate to trusted certificates from inside a Java keystore?
- filter only not empty arrays dataframe spark
- How can I get all names of the arrays on Dataframe
- create a Spark DataFrame from a nested array of struct element?
- spark UI - Understand metrics memory used
- Tapir custom http code in successful response
- Remove list elements in a dataframe in scala
- Search a dataframe from a list and add column to say found or not
- Not able to Explode and select in the same expression in spark scala
- Why am I getting "No SLF4J Providers found" in my Scala + AKKA Jar?
- How to convert a java Map to immutable Scala map via java code?
- How to correctly read a CSV file while escaping delimiter comma placed within square brackets using Apache Spark and Scala?
- How to remove an item from a list in Scala having only its index?
- Multiple image operations in a single process with gm4java
- In Scala, how would I update specific items in a Seq using a filter?
- Scala actors as single-threaded queues
- What is the difference between Abstract Data Types and Algebraic Data Types
- How to cancel a future action if another future did failed?
- Manifest and abstract type resolution
- How to I convert a HttpEntity into a Protobuf object in Scala using Akka-http?
- How to keep reference to a created instance of Actor class with Akka?
- Scala: An extension method was tried, but could not be fully constructed (same extension name on multiple classes)
- Doobie - lifting arbitrary effect into ConnectionIO
- Why does Scala not have the concept of checked and unchecked exceptions?
- Trying to create a classic actor from inside of a akka typed application
- How to get a random element from a Set in Scala
- Convert Iterable[Any] to string in scala
- How to create an Instance of a generic class in Scala 3 Metaprogramming
- Removing an element from Seq