Search code examples
apache-flink

Using Flink LocalEnvironment for Production


I wanted to understand the limitations of LocalExecutionEnvironment and if it can be used to run in production ?

Appreciate any help/insight. Thanks


Solution

  • LocalExecutionEnvironment spins up a Flink MiniCluster, which runs the entire Flink system (JobManager, TaskManager) in a single JVM. So you're limited to CPU cores and memory available on that one machine. You also don't have HA from multiple JobManagers. I haven't looked at other limitations of the MiniCluster environment, but I'm sure more exist.