amazon-web-services apache-spark amazon-emr

Could AWS EMR run multi spark application in parallel in single cluster?

I know an EMR cluster could have multiple steps and EMR will run these steps sequentially. But is it possible to let EMR run steps in parallel?

Solution

Yes, you can. From AWS docs:

You can also choose to run multiple steps in parallel to improve cluster utilization and save cost.

Changing the name of a Load Balancer on AWS Console
Timeout when trying to retrieve EC2 instance-id metadata from within it
Row was updated or deleted by another transaction (or unsaved-value mapping was incorrect)
Downloading an entire S3 bucket?
Unable to unzip .zip file on linux machine
Missing Authentication Token while accessing API Gateway?
AWS S3 Access Denied when open object URL in browser
AWS Lambda NodeJs unable to return response
How can I access my AWS MSK managed kafka queue from my local machine and EC2 instances in other regions
How to recreate EC2 instances of an autoscaling group with terraform?
AWS Cloudwatch Alarm Issue
AWS EC2 | using Rusoto SDK: Couldn't find AWS credentials
How to enable "Use for Hive table metadata" in "AWS Glue Data Catalog settings" using Terraform?
Determine if instance is a part of some AutoScaling Group in AWS
Difference bw "start_of_file" and "end_of_file" in AWS cloud agent configuration
not authorized to perform: ec2:DescribeInstances because no identity-based policy allows the ec2:DescribeInstances action
Environment specific ebextensions Beanstalk commands
Deleting records from a DynamoDB table where the TTL value has been set incorrectly
MySQL/Amazon RDS error: "you do not have SUPER privileges..."
Is EC2 t3.micro created by ECS cluster eligible for free tier?
Amazon Neptune OpenCypher - What is the cause for "Operation terminated (internal error)" when using SET after MERGE?
AWS SAM CLI cannot access Dynamo DB when function is invoked locally
EC2 instance connect : There was a problem setting up the instance connection
Wildcard filter in aws-nuke
Add advanced validation for AWS::Serverless::Api GET query params
Organizing AWS IAM permissions: limit of 10 policies?
AWS: S3 Bucket AWS You can't grant public access because Block public access settings are turned on for this account
failed calling webhook "vingress.elbv2.k8s.aws"
terraform tags for list variable not working
Amazon SES successfully forwarded emails but respond with 451 4.3.0 This message could not be delivered