Search code examples
apache-sparkstreamingsparkr

streaming in sparkR?

I have been using Spark in Scala for a while. I am now looking into pySpark and SparkR. I don't see streaming mentioned for PySpark and SparkR. Does any one know if you can do Spark streaming when using Python and R?

Solution

  • Spark is now supporting pySpark streaming in 1.3. And an implementation of SparkR streaming can be found in https://github.com/hlin09/spark/tree/SparkR-streaming.