Search code examples
amazon-web-servicesamazon-s3snowflake-cloud-data-platformparquet

Different permissions same S3 bucket, parquet files


Problem I have multiple files in the same S3 bucket. When I try to load one file into Snowflake, I get a "access denied" error. When I try a different file (in the same bucket), I can successfully load into Snowflake.

The file highlighted does not load into Snowflake.

File does not load

This is the error

Error


Using a different file but in the same bucket, I can successfully load into Snowflake.

this file loads

Known Difference: The file that does not work was generated by AWS. The file that can be loaded into Snowflake was generated by AWS, saved to my local then reuploaded to the bucket.

The only difference is I brought it down to my local machine.

Question: Is there a known file permission on parquet files? Why does this behavior go away when I download and upload to the same bucket.

It cannot be an S3 bucket issue. It has to be some encoding on the parquet file.


Solution

  • Turns out I needed to add KMS permissions to the user accessing the file.