Search code examples
javakubernetesstreamingapache-flinkflink-streaming

Flink in Kubernetes. How to add submit job step to jobmanager flink docker?

I use Flink with K8s. Everything works fine, but I have to submit jar manually when jobmanager is up.

I think we can extend flink image and add post action to submit job. So jobmanager will be one for one flink job. I think it was the idea from https://www.youtube.com/watch?v=w721NI-mtAA

In this case if JM is down, K8s will up new pod and resubmit the job.

Am I right?

Does anyone have such docker changes for flink?

Solution

  • I solved this stuff.

    I extend flink Docker and added "Flink run "some.jar"" step to it.

    It works perfect

    https://github.com/Aleksandr-Filichkin/flink-k8s