Search code examples
amazon-web-servicesaws-glue

Is there a way to run aws glue crawler after job is finished?


For example I run ETL and new fields or columns may be added for target table. To detect table changes a crawler should be run but it has only manual or schedule run.

Can crawler be triggered after job is finished?


Solution

  • import boto3
    glue_client = boto3.client('glue', region_name='us-east-1')
    glue_client.start_crawler(Name='name_of_crawler')
    

    Copy this code snippet at the end of your code.