Search code examples
hadoopreal-timedata-analysis

Best way to do real time data analytics

I'm currently am interested in performing real time data analytics using real time aircraft performance data for predictive analysis. What tools and technologies could be used to implement such a system on research level?

Solution

  • For real time data analytics if i would be in your place i would have choose the following technologies

    1) Kafka for real time Data Ingestion.

    2) Spark Streaming for Streaming Processing

    3) Spark ML for using machine learning algorithms (Prediction)

    4) Apache Zeppelin for Visualization.

    5) Data Storage you can use Hive or HDFS as per your needs

    6) Ganglia for performance monitoring

    Hope this Helps!!!...