Is there a way to enable the Spark UI (by storing the logs in s3) while running a Glue job using an interactive notebook?
Inside the Notebook, you have to add
%%configure
{
"--enable-spark-ui": "true",
"--spark-event-logs-path": "s3://path/here"
}