Installing spark-sql-kinesis_2.11-2.2.0.jar in my Spark environment

Question

I am using an EMR cluster to develop/run Spark jobs. Now I need to access Kinesis and need to install spark-sql-kinesis_2.11-2.2.0.jar. I am not very clear on how to do that yet. Any pointer/experience will be very helpful

Answer 1

I ended up building it myself from the source code (github) and then specified it in my spark-submit code. That seems to be recommended.