Search code examples
aws-glue

How to enable spark UI for Glue Interactive notebooks?


Is there a way to enable the Spark UI (by storing the logs in s3) while running a Glue job using an interactive notebook?


Solution

  • Inside the Notebook, you have to add

    %%configure
    {
        "--enable-spark-ui": "true",
        "--spark-event-logs-path": "s3://path/here"
    }