Search code examples
azuredatabricksazure-databricks

Azure Databricks without /FileStore and /Users

I just created a Databricks workspace on Azure and configured the access token for the Databricks CLI.

Everything works. Blob Storage mounts, JDBC database access and the CLI.

But: the filesystem looks strange. I remember that there where /Users and /FileStore under dbfs:/ when calling dbfs ls. They are missing.

When choosing "Copy File Path" for a notebook, the path is the expected /Users/[email protected]/NoteBookName but neither path nor notebook show up when calling dbfs ls.

What is going on here?

Solution

  • The /Users folder that you see in the Workspace for notebooks is not stored in DBFS. You maybe able to find the notebooks if you poke around:

    %sh ls /

    The FileStore is stored in DBFS but created on demand (or manually).