Search code examples
amazon-web-servicesamazon-ec2aws-glue

Remove/Rename Special Character while creating column name using AWS Glue Crawler


I am crawling an S3 bucket using AWS Glue Crawler which creates table schema in Athena.

I understand Athena does not support column names which have special characters like \ (backward slash) etc.

Is there a way which can exclude/rename these column names while the crawler is crawling from the S3 bucket?

I have a few columns names like (RelatedAWSResources:0/name) which give me an error when I query them in Athena.

Any help is appreciated.


Solution

  • Sadly, there is no such way. What you could probably do is to setup AWS Glue Job, and transform all your data to a format that is suitable for Athena.