How to perform data comparison between 2 kafka topic using flink

Question

I got stuck at scenario where i need to consume data stream from 2 or more kafka topics(after applying filter) and compare the data. Since the data volume is high, Please suggest the best options available.. Is it possible with flink?

Answer 1

There are several different ways one might potentially use to approach this with Flink. The more straightforward options are probably to either use

• an interval join
• or some sort of Table or SQL join.

Using Kafka with the Table/SQL APi is covered here.