Search code examples
apache-sparkcluster-computingmode

Difference between spark standalone and local mode?


What is the difference between Spark standalone and Local mode?


Solution

  • Spark standalone is a resource manager which can work on a cluster. It is simply the built in resource manager as opposed to an external one like yarn.

    Spark local runs without any resource manager, everything runs in a single jvm (you can decide the number of threads). This is aimed for testing locally.