Not Able To HIVE databases in Databricks Community Edition
I have been using Databricks Edition for many years now, and suddenly I'm no longer able to view HIVE databases. I'm getting the following message when I select Data
I normally see my HIVE database here. Has there been a massive change?
My bad @Patterson, it was not meant to be an answer...I am also dealing with this issue... But if you want to see your hive database(s), I would recommend you to enable DBFS by following these steps (see image below):
- Go to the admin console.
- Click the Workspace Settings tab.
- In the Advanced section, click the DBFS File Browser toggle.
- Click Confirm.
Once you do this refresh page and then you can access your file directory "DBFS". Under /user/hive/warehouse/ you will find your default database and other databases you might have created... However, the database(s) under "Database Tables" are still not showing, for me at least.
I would recommend you to use these two statements to get more information about your schemas/databases:
%sql
describe detail <schema>.<table_name>
and
%sql
describe history <schema>.<table_name>
I hope you can find your hive's databases.
- check if delta table exists on a path or not in databricks
- Azure Cost Management - track costs associated with Databricks job
- Spark getItem shortcut
- Check whether boolean column contains only True values
- Is it safe to run VACUUM and DELETE against a Delta Table while there's a Spark Streaming query doing data ingestion
- Dataframe.write() produces csv file on single node jobs cluster, but not on 2+1 nodes cluster
- How to stream data from a Databricks model serving endpoint?
- Check consecutive days in SQL
- I would like to Create a (cron) schedule in Databricks that runs a job on Wednesday after the first Monday of a month
- Databricks job cluster per pipeline not per notebook activity
- Azure CICD pipelines
- PySpark join dataframes with unique ids
- Counting items in an array and making counts into columns
- DeltaLake/DeltaTable merge operation inserts/duplicates matched rows not updating them
- How to set model owner programmatically within databricks and mlflow?
- Giving View permission to Databricks jobs using CLI or API
- What is the correct way to install the delta module in python?
- How to write pandas dataframe into Databricks dbfs/FileStore?
- Clone/Copy repo from AzureDevOps to Databricks
- Integer to date conversion within Databricks
- Databricks String (XML) columns parsing
- Dynamic Transpose of Rows to Columns in Databricks SQL
- Scheduling job every other day in Azure Databricks
- SQL data wrangling help using the Having statement
- Is it possible to disable Databricks Managed Storage Account public access?
- Spark SQL XML Parsing
- Error When Mounting ADLS Gen 2 abfss from Databricks: Error IllegalArgumentException: Unsupported Azure Scheme: abfss
- In pyspark, what is the difference between dlt.read_stream() and spark.readstream()?
- Why to use Spark Structured streaming AvailableNow and not just normal batch dataframes?
- Reading Excel(xlsx) with Pyspark does not work above a certain medium size