Search code examples
amazon-web-servicesamazon-s3aws-glueamazon-athena

Get AWS Glue Crawler to re-visit the folder for a partition that's been deleted


I have an AWS Glue crawler that is set-up to crawl new folders only. I tried to see if deleting a partition would cause it to re-visit the corresponding S3 folder, and it doesn't. Is there a way I can force a re-visit of a folder, short of changing the crawler to crawl all folders?


Solution

  • If you just wish to 'notice' a deleted partition, you could run MSCK REPAIR TABLE tablename.

    Not sure the best way to automate it (perhaps Lambda to Athena?).