Search code examples
azureloggingdatabricksanalytics

Azure Databricks and log analytics setup requires a restart or rebuild?

Followed this link to setup Databricks and Log Analytics:

Log analytics in Databricks Azure

My question is, does this require a cluster/workspace rebuild or restart?

Ideally a restart is preferable since we have jobs running using the Databricks URL.

Thanks for any help you may provide.

Solution

  • My question is, does this require a cluster/workspace rebuild or restart?

    There is no need to rebuild the cluster, restart action is sufficient for Azure Databricks and log analytics setup.

    According to documentation, you can use this diagnostic log event schema Microsoft.Databricks/<category>/<actionName> such as Microsoft.Databricks/<clusters>/<restart>

    You can refer to Monitoring Azure Databricks with Log Analytics and Azure Databricks Best Practices