ADF databricks python activity to pick python script from blob storage not from dbfs

Question

I'm running databricks python activity from the Azure data factory. I want to pick the python/shell script from Azure blob-storage/data-lake instead for dbfs path. My current ADF databricks python activity is not allowing without 'dbfs:/'.

Could you please help me here.

Answer 1

Only dbfs file path is supported in the Databricks Python activity: https://learn.microsoft.com/en-us/azure/data-factory/transform-data-databricks-python#databricks-python-activity-properties

you need to think of other methods for uploading the python file to dbfs using databricks cli, potentially through your cicd pipeline also.