Search code examples
amazon-s3amazon-vpcamazon-neptune

Amundsen - Unable to load data from S3 to Neptune

I am facing a problem when loading the data from S3 to Neptune.

Exception: Failed to load csv. Response: {'detailedMessage': 'Unable to connect to s3 endpoint. Provided source = s3://amundsendev/amundsen_data/2022_07_28_17_27_05 and region = us-east-1. Please verify your S3 configuration.', 'code': 'InternalFailureException', 'requestId': '1afc36a9-e5db-433d-9563-d40165069b3a'}

enter image description here

Really appreciate some help here !!

Solution

  • Amazon Neptune instances reside within a VPC and do not have native access to the Internet (which includes S3, as S3 is a public facing service). In order for your Neptune instances to connect to S3, you'll need to deploy an S3 VPC Endpoint in your VPC and associate it with the route table(s) used by your Neptune instances' subnets.

    More in the docs here: https://docs.aws.amazon.com/neptune/latest/userguide/bulk-load-tutorial-IAM.html#bulk-load-tutorial-vpc