"Stream Processing with Apache Flink" how to run book code from IntelliJ?
As described in this post I have been unable to successfully run any code from the book "Stream Processing with Apache Flink, including the precompiled jar.
It is not my practice to use an IDE but I thought I would try to use IntelliJ as Chapter 3 "Run and Debug Flink Applications in an IDE" describes how to do that specifically for the code for this book.
The book describes a project import process that I have not found a way to use. It describes setting options on import, for example select Maven. I have not found a way to set any options on import.
I am able to import a project and run code. The code fails, looks like with missing dependency. Maybe because it isn't a Maven project?
Here are steps to reproduce
git clone https://github.com/streaming-with-flink/examples-scala.git
Start IntelliJ
Choose "Open or Import" and Select the "examples-scala/" folder. The project imports with no chance to select options.
Now I have a project
Browse to AverageSensorReadings class, open, and run.
Errors with
java.lang.NoClassDefFoundError: org/apache/flink/api/common/typeinfo/TypeInformation
How can I run this code in IntelliJ?
I see that flink dependencies have provided scope in Maven - this means that thay are not included into the classpath when you running the application. Most likely the application is meant to be run on environment where these dependencies already exist (e.g. Hadoop). To be able to run it from from IDE set Include dependencies with "Provided" scope option in Run Configuration:
- Spark Send DataFrame as body of HTTP Post request
- Mix Lombok, Java and Scala in a maven project
- Best way to turn a List of Eithers into an Either of a List?
- Why scala compiler says that this type is used in non-specializable position?
- Understand how to use apply and unapply
- Scala fold function to detect occurrence of a value in Seq[String]
- How to generate Verilog rather than SystemVerilog from Chisel?
- How to specify indentations on multiline parameter lists in IntelliJ Scala?
- Scala GroupBy preserving insertion order?
- Scala - complex conditional pattern matching
- Difference between Array and List in scala
- What is the recommended way to setup integration test in sbt after the deprecation of custom configs
- Scala - List("a","b").map(fn) versus map(fn, List("a","b")
- Ideal Scala's compiler and libraries using Play framework
- Stream-Static Join: How to refresh (unpersist/persist) static Dataframe periodically
- How to make IntelliJ IDEA use javac for Java and scalac for Scala?
- What's the difference between == and .equals in Scala?
- Why AWS is rejecting my connections when I am using wholeTextFiles() with pyspark?
- How do I use a nightly build of Scala?
- Run only one package test cases scala
- Is `finally` block executed in case there is `return` inside a `try` or a `catch` block?
- What Scala version is used in maven Scala plugin by default?
- Difference between trait inheritance and self type annotation
- Scala: checking if an object is Numeric
- How to write spark streaming DF to Kafka topic
- Per EntityType Active Entity Limit in Cluster Sharding Passivation
- What are the Spark transformations that causes a Shuffle?
- Scala closures filename
- How to customize serialization of a key of a Map with jsoniter
- Scala 3: typed tuple zipping