I am using the AWS Glue service with two separate workflows (let's say workflow A and workflow B).
I have created a conditional-type trigger in workflow B that watches jobs in workflow A and supposedly fires when they succeed. Can this trigger actually fire if it watches jobs from workflow A (i.e. a different workflow)?
I have tested this a few times, but it seems the jobs in workflow B that are supposed to be triggered by this specific trigger don't seem to run despite all jobs that are being watched succeeding.
I can't seem to find any information on this specific AWS Glue setup.
From the AWS docs it seems that triggers that start a workflow must be of one of the following types:
Link: https://docs.aws.amazon.com/glue/latest/dg/workflows_overview.html
A solution to my problem might be to omit Workflows entirely and just create triggers and jobs.