aws-stepfunctions-tasks for starting Glue job run #5266
Labels
@aws-cdk/aws-stepfunctions
Related to AWS StepFunctions
effort/medium
Medium work item – several days of effort
feature-request
A feature should be added or improved.
in-progress
This issue is being actively worked on.
As mentioned in https://docs.aws.amazon.com/step-functions/latest/dg/connect-glue.html, one can trigger an AWS Glue job run and monitor its state synchronously from Step Functions using a Step Functions state, as shown in the example:
This request is for a feature, similar to @aws-cdk/aws-stepfunctions-tasks.RunLambdaTask, @aws-cdk/aws-stepfunctions-tasks.RunEcsFargateTask, etc, but for an AWS Glue job - perhaps called
@aws-cdk_aws-stepfunctions-tasks.RunGlueJobTask
Use Case
For use in creation of Step Functions definitions with Glue job states.
Proposed Solution
Implementation would likely be very similar to https://github.com/aws/aws-cdk/blob/v1.18.0/packages/%40aws-cdk/aws-stepfunctions-tasks/lib/run-lambda-task.ts, but with tweaks to have the "Resource" arn always point to
"arn:aws:states:::glue:startJobRun.sync"
with the proposed@aws-cdk_aws-stepfunctions-tasks.RunGlueJobTask
interface only requiring the Glue "JobName".Other
This is a 🚀 Feature Request
The text was updated successfully, but these errors were encountered: