"sparkContext was shut down" while running spark on a large dataset...

Kerberos and yarn nodemanager fail to connecting resourcemanager. Failed to specify server's Ker...

Spark on YARN: Less executor memory than set via spark-submit...

Specifying mapreduce.map.java.opts without overriding memory settings?...

Where to find node logs in AWS EMR cluster?...

Getting exception while launching yarn jobs due to kafka log4jappender...

What is the difference between submitting spark job to spark-submit and to hadoop directly?...

What is the main constraint on running larger YARN jobs and how do I increase it?...

Running Spark jobs on a YARN cluster with additional files...

What does "% of Queue" refer to in the hadoop yarn UI...

How many concurrent tasks in one executor and how Spark handles multithreading among tasks in one ex...

No module error when running spark-submit...

Error Running Yarn Jar MRAppMaster NoSuchMethodERror...

YARN vs Spark processing engine based on real time application?...

Get Yarn application id before SparkSession is instantiated...

Hive Runtime Error while processing row in Hive...

YARN not using all memory available in a Google Dataproc instance...

Hadoop Yarn: How to limit dynamic self allocation of resources with Spark?...

Access a secured Hive when running Spark in an unsecured YARN cluster...

Autoscaling metrics on GCP Dataproc on YARN...

How do I kill a YARN container to test failure scenarios...

Submiting Flink Job on YARN Issue...

hive add partition statement ignores leading zero...

YARN complains java.net.NoRouteToHostException: No route to host (Host unreachable)...

how to increase java heap size in Hadoop...

Saving garbage collection logs into ${yarn.nodemanager.log-dirs}/application_${appid}/container_${co...

YARN container failing with error code -104 and 143 in spark job...

Are there any spark configuration parameters that one can tune in order to decrease the driver node ...

spark on yarn cluster creates a spark job with the number of workers that is much smaller than what ...

Can two executors / drivers from different Spark applications run on same node in cluster mode?...