Search code examples
postgresqlspring-bootdatasetapache-flinkbatch-processing

Is it possible to read data directly from a database table for batch processing in Apache Flink than reading from a csv file?


I need my Flink batch job to read data from my Spring Boot project's postgres database. The option I saw in Flink is only for reading from csv files. In that case I need to create a csv file from my table. Is there any solution out there?


Solution

  • If You want to read the data from Postgres (which I assume this question is about) You can use Flink JDBC connector, which will allow reading from various databases including the Postgres. You can find more info here.