My requirement is I have one Dev Databricks Instance in which all the dev code is present and this dev code is integrated with Azure REPOS Git (Azure DevOPS).
I have another Databricks instance Prod, I want to push all the dev code from dev Databricks instance to Prod Databricks instance and I want to achieve this using Azure Devops CICD Pipeline.
How to achieve this ?
There is this URL https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/ci-cd-azure-devops for setting up CICD for Databricks but I found this is very complex and lot of steps involved.
Can anyone help me to achieve this in simple steps rather than as mentioned in above URL. Kindly Help.
I have followed this article to resolve.
https://purple.telstra.com/blog/how-to-setup-ci-cd-for-databricks-on-azure-devops
Note : Install necessary extensions from https://marketplace.visualstudio.com mentioned in this article.