Search code examples
databricksazure-databricks

How do I pass content of variables from one notebook to another in a databricks workflow?

I am looking for a way to access data from other notebooks in a Databricks Workflow.

Meaning. I have some results in Notebook A and Notebook B that depends on Notebook A. Notebook B wants to access the results.

Solution

  • When writing this question, the Workflows in Databricks are one year old.

    It seems there is no way at the time of writing this by Databricks

    https://community.databricks.com/s/question/0D53f00001kL6tpCAC/how-to-pass-outputs-from-a-python-task-to-a-notebook-task.

    And the only way to do it would be to store it in a DB table