Fastest way to download large files from AWS EC2 EBS

Question

Suppose I have a couple of terabytes worth of data files that have accumulated on an EC2 instance's block storage.

What would be the most efficient way of downloading them to a local machine? scp? ftp? nfs? http? rsync? Going through an intermediate s3 bucket? Torrent via multiple machines? Any special tools or scripts out there for this particular problem?

Answer 1

Please follow these rules:

• Move as one file, tar everything into a single archive file.
• Create S3 bucket in the same region as your EC2/EBS.
• Use AWS CLI S3 command to upload file to S3 bucket.
• Use AWS CLI to pull the file to your local or wherever another storage is.

This will be the easiest and most efficient way for you.