amazon-web-servicesapache-sparkaws-glueamazon-emr
How to access existing Glue catalog from EMR?
I have created a Glue catalog in my account. It has 1 DB and 1 table.
I followed this guide from AWS and created my EMR cluster. However, when I run spark-shell and try to access Glue catalog, I am not able to see the database from Glue catalog being accessed in my EMR.
What am I missing?
Solution
This was a non issue. I was trying to launch and EMR in US-East-1, and for some reason, the EMR was not getting provisioned even if the underlying EC2's were provisioned and in running state. I was able to ssh to the EC2s and run spark-shell on them too.
I launched an EMR in US-East-2 and it was completely provisioned. I was able to connect to the Glue catalog successfully.
- Unable to delete cfn stack, role is invalid or cannot be assumed
- How to Set Up Account Linking for a Skill using Alexa API from Amazon?
- GitHub actions "aws: not found" error on ubuntu-latest with Godot CI
- Download file from S3 to Rails 4 app
- Cloudfront (CDN) with Internal Application Load Balancer
- Connecting private load balancer to cloud front distribution?
- Request to Amazon API with delphi : Got HTTP/1.1 403 Forbidden
- Shift Lambda infrastructure to ECS
- IAM policy to allow EC2 instance API access only to modify itself
- How to match these 2 tables?
- What is the best way of getting files from AWS S3, inserting them into zip and uploading that zip to the bucket?
- What does this mean? An error occurred (SignatureDoesNotMatch) when calling the GetCallerIdentity operation: Signature expired
- How to query: filtering on multiple primary partition keys and range on primary sort key
- How can I get boto3 script to run as a Lambda function?
- Testing AWS CDK Applications Locally
- Downloading an entire S3 bucket?
- AWS ElastiCache SNS notifications Inactive
- How to set credentials in AWS SDK v3 JavaScript?
- Redis HINCRBY hash field -1 counter for decrementing only till 0 or non negative value
- Error creating mediaconvert job for HLS output with mp4, mp3 and SRT as input
- Firehose Stream Delivers to S3 in Uncompressed Format Despite Compression Enabled
- AWS S3 Bucket Policy - Only Allow Certain File Types In Folder
- couldn't get current server API group list: the server has asked for the client to provide credentials error: You must be logged in to the server
- AWS DotNet SDK Error: Unable to get IAM security credentials from EC2 Instance Metadata Service
- AWS passive failover pricing
- Is there any API available for AWS Pricing Calculator
- Append data to an S3 object
- How to handle UnprocessedItems using AWS JavaScript SDK (dynamoDB)?
- AWS SAM-defined ECS Fargate scheduled task won't start
- How to configure AWS Application Load Balancer to point to multiple ports on the same server