Flink - External Checkpoints on AWS

Question

I plan to use Flink on AWS Kinesis Analytics for Java Applications to perform stateful streaming aggregation.

I'd like to save checkpoints to a persistent store. What are my options?

• Can I use S3 using FsStateBackend?

• What about RocksSB? Is RocksDB offered our of the box by AWS Kineses Analytics for Java Applications?

Thanks!

Answer 1

Regarding Flink checkpointing in Kinesis Data Analytics for Java Applications, this article shows how to configure checkpointing to S3 bucket. Seems like S3 is the persistent store recommended by AWS.

You can see that FsStateBackend supports S3 in Flink's official docs.