How to use Spark application name in logs?...

Apache ranger yarn plugin is not working as expected?...

Time spent in accepted state by a YARN job...

Yarn CPU usage and the result of htop on workers are incosistent. I am running a SPARK cluster on Da...

Dataproc CPU usage too low even though all the cores got used...

Yarn allocates only 1 core per container. Running spark on yarn...

Which cluster type should I choose for Spark?...

flink sql with Couldn't retrieve Yarn cluster...

When does a Spark on YARN application exit with exitCode: -104?...

What additional benefit does Yarn bring to the existing map reduce?...

Spark on YARN resource manager: Relation between YARN Containers and Spark Executors...

Apache Spark Python to Scala translation...

HDFS staging dir permission issues with yarn mapred framework - /tmp/hadoop-yarn/staging...

Creating a 50Giga parquet file of random integers using pyspark fails...

YARN Application exited with exitCode: -1000 Not able to initialize user directories...

Submitting Multiple Jobs in Sequence...

Apache Spark on YARN: Large number of input data files (combine multiple input files in spark)...

How can I get job configuration in command line?...

do we need to install spark on yarn to read data from HDFS into Py Spark?...

Where are the spark intermediate files stored on the disk?...

Spark Memory Usage Concentrated on Driver / Master...

NoSuchMethodError: org/apache/hadoop/mapreduce/util/MRJobConfUtil.setTaskLogProgressDeltaThresholds...

Spark on Yarn memory(physical+virtual) usage...

Hadoop: specify yarn queue for distcp...

Spark yarn cluster vs client - how to choose which one to use?...

Yarn (Node and Resource Manager) not Running, Hadoop 3.2.1 Installation Windows 10...

How to kill an EMR task programatically...

Spark - Remove column from bean before writing in partitions...

Hadoop: Cannot set priority of resourcemanager process...

Spark application in incomplete section of spark-history even when complited...