Search code examples
apache-flinkflink-streamingflink-checkpoint

upgrade Flink minor version and restore from checkpoint


From official doc, it says Flink support minor version upgrade - restoring a snapshot taken with an older minor version of Flink (1.x → 1.y)..

Q1. Does it means I can upgrade Flink version of my job in following way:

  1. Stop job running with Flink 1.10.
  2. Record latest checkpoint, for example: chk-123.
  3. Upgrade Flink to 1.15(or higher).
  4. Restore the job with chk-123.

Q2. I found there is savepoint compatiabiliy table, but checkpoint is not mentioned. Is checkpoint compatiabiliy table the same as savepoint, or just as described as Flink (1.x → 1.y) (x means any version previous than y)?


Solution

  • I think it should work the same way for externalized checkpoint as for savepoint in terms of compatibility. The thing is that savepoints are done automatically when You stop the job, so they are a natural pick when updating a version of Flink to minimize the amount of data reprocessed. Is there a reason why You can't use savepoint?