Search code examples
apache-sparkloggingimportexportrdd

Apache Spark History Server Logs


My Apache Spark application handles giant RDDs and generates EventLogs through the History Server. How can I export these logs and import them to another computer to view them through History Server UI?


Solution

  • My cluster uses Windows 10 and for some reason, with this OS, the log files don't load if they aren't generated on the machine itself. Using another OS like Ubuntu, I was able to view History Server's logs on the browser.