Search code examples
javaapache-flinkflink-streaming

Can a sink be the next data source in Apache Flink


I'm using Apache Flink to process streaming data.

Saying that I have two jar files a.jar and b.jar. My question is if it is possible to use the sink of a.jar as the data source of b.jar.

If it's possible, can you show me a simple example?

If not, what could I do? Must I use something like a Database to store the output of the sink of a.jar and use the Database as the data source of b.jar?


Solution

  • To get exactly-once guarantees, you'll have to implement this decoupling with a stream storage layer that supports transactions and stream replay.