Search code examples
apache-spark-sqlazure-synapsedelta-lake

Synapse Lake database view not available in SQL Pool?


Currently exploring using Spark notebooks in Synapse for data transformation instead of data flows but the lake db capabilities are a little confusing.

I created a lake db, an external table (catalog?) and a view using a notebook in Synapse Workspace. The view is visible in the Synapse UI and I can query it. But the view is not available when connecting via the SQL pool using management or data studio for example. Are only table meta data shared, or am I missing something? Having trouble finding documentation regarding this.


Solution

  • But the view is not available when connecting via the SQL pool using management or data studio for example. Is this intended, or am I missing something?

    • The Serverless SQL Pool and the Spark Pool share a catalog, but the Dedicated SQL Pool has its own.
    • Spark views are session (temp views) or app (global views) scoped and do not belong in the catalog. That is the reason you don't see views.