Search code examples
spring-bootspring-cloud-streamspring-cloud-dataflow

How to persist Twitter stream data to Postgres database using Spring Cloud Dataflow?


I am new to Spring Spring Boot, and Spring Cloud Dataflow. I am currently working on a POC and the goal is to load and persist streaming data into a relational database(as opposed to a batch job in traditional ETL).

I had successfully set up the stack for Spring Cloud Dataflow with the official docker-compose file. And I was able to follow the example on streaming and doing analytics on twitter streams. However since I don't have a deep enough understanding of this, I am not able to figure out how to persist these streams of data into a relational database (Postgres for example). Can anyone give me some hints on where to start? Any help is appreciated.


Solution

  • See the JDBC Sink app starter.