Aws data pipeline trigger aws glue crawler

Question

I have an Aws Data Pipeline with an EMR Activity, which writes data on S3. At the end of this process, it also writes some metadata to a specific S3 folder in that location.

Is there a way to trigger an Aws Glue crawler from within a Data Pipelines definition - which scans this last S3 location, so that it creates an Aws Athena table?

I haven't found a way to do this looking in the Aws Data Pipelines documentation.

Answer 1

Maybe you could use ShellCommandActivity and call aws glue start-crawler.