Connectiong to Azure table storage from Azure databricks
I am trying to connecto to azure table storage from Databricks. I can't seem to find any resources that doesn't go to blob containers, but I have tried modifying it for tables.
spark.conf.set(
"fs.azure.account.key.accountname.table.core.windows.net",
"accountkey")
blobDirectPath = "wasbs://accountname.table.core.windows.net/TableName"
df = spark.read.parquet(blobDirectPath)
I am making an assumption for now that tables are parquet files. I am getting authentication errors on this code now.
According to my research, Azure Databricks does not support the data source of Azure table storage. For more details, please refer to https://learn.microsoft.com/en-gb/azure/databricks/external-data/.
Besides if you still want to use table storage, you can use Azure Cosmos DB Table API. But they have some differences. For more details, please refer to https://learn.microsoft.com/en-us/azure/cosmos-db/faq#where-is-table-api-not-identical-with-azure-table-storage-behavior.
- Is it possible to call setter as a method?
- Accessing a Python traceback from the C API
- Scraping hierarchical website in a specific category
- How to offset a marker in matplotlib?
- How to access current user in Django class based view
- Is there a way to define list(obj) method on a user defined class in python?
- Deserializing Json list into class objects not able to extract attrributes
- What is the pythonic way to detect the last element in a 'for' loop?
- How to get integer values from a string in Python?
- Optimize this Python code that involves matrix inversion
- how to read a file with dictionary?
- How to extract only audio from downloading video? Python yt-dlp
- How to solve Invalid element(s) received for the 'color' property?
- Plotly Value error - Invalid property for colour
- no module named distutils....but distutils installed?
- how can i change the venv of my current shell from within a python script
- What is the difference between "cast(...)" and "... # type: ..."?
- getting the file size with pycurl
- export conda environment without prefix variable which shows local path to executable
- How can I fix datetime error when trying to use the now syntax?
- Python 3 asyncio with aioboto3 seems sequential
- How can I set OpenCV to use origin as bottom-left corner of image?
- Can I use sleep in the main thread without blocking other threads?
- Getting number of elements in an iterator in Python
- Merging tuples if they have one common element
- How to specify the response_model in FastAPI on a non-default return?
- PyCharm doesn’t see files in project
- How to tune PID controller on non-linear model (here: diving of a body)
- Create list of factorials using list comprehension
- Rewriting URL request function to satisfy GitHub CodeQL server side request forgery (SSRF) warning