(aws-stepfunctions-tasks): Cannot provide JSONPath as entrypoint arguments to EmrContainersStartJobRun task

[gnovack]

Describe the bug

When using the EmrContainersStartJobRun Step Functions Task, I cannot provide the entryPointArguments to the EMR job as an encoded JSON path parameter.

e.g.

const emrContainersStartJobRun = new EmrContainersStartJobRun(this, "EmrEksJob", {
  virtualCluster: VirtualClusterInput.fromVirtualClusterId("1234"),
  releaseLabel: ReleaseLabel.EMR_6_3_0,
  jobDriver: {
    sparkSubmitJobDriver: {
      entryPoint: TaskInput.fromText("local:///usr/lib/spark/examples/src/main/python/pi.py"),
      entryPointArguments: TaskInput.fromJsonPathAt("$.entrypointArguments")
    }
  }
})

Expected Behavior

I expected that the above code would synthesize without error, and that the resulting state JSON from the above task would look like this:

{
    "VirtualClusterId": "1234",
    "ReleaseLabel": "emr-6.3.0-latest",
    "JobDriver": {
        "SparkSubmitJobDriver": {
            "EntryPoint": "local:///usr/lib/spark/examples/src/main/python/pi.py",
            "EntryPointArguments.$": "$.entrypointArguments"
        }
    }
}

Current Behavior

The following error occurs when running cdk synth and the CloudFormation template is not synthesized:

Entry point arguments must be a string array or encoded JSON path but received string.

Reproduction Steps

Attempt to synthesize the CDK stack below by running cdk synth

import { Stack, StackProps } from 'aws-cdk-lib';
import { Construct } from 'constructs';
import { EmrContainersStartJobRun, ReleaseLabel, VirtualClusterInput } from 'aws-cdk-lib/aws-stepfunctions-tasks';
import { TaskInput } from 'aws-cdk-lib/aws-stepfunctions';

export class EmrEksCdkStack extends Stack {
  constructor(scope: Construct, id: string, props?: StackProps) {
    super(scope, id, props);
    
    new EmrContainersStartJobRun(this, "EmrEksJob", {
      virtualCluster: VirtualClusterInput.fromVirtualClusterId("1234"),
      releaseLabel: ReleaseLabel.EMR_6_3_0,
      jobDriver: {
        sparkSubmitJobDriver: {
          entryPoint: TaskInput.fromText("local:///usr/lib/spark/examples/src/main/python/pi.py"),
          entryPointArguments: TaskInput.fromJsonPathAt("$.entrypointArguments")
        }
      }
    });
  }
}

Possible Solution

It appears that the following validation function needs to be modified to correctly detected when the input is an encoded JSON Path:

aws-cdk/packages/@aws-cdk/aws-stepfunctions-tasks/lib/emrcontainers/start-job-run.ts

Lines 212 to 220 in c8f5cd2

	private validateEntryPointArguments (entryPointArguments:sfn.TaskInput) {
	if (typeof entryPointArguments.value === 'string' && !sfn.JsonPath.isEncodedJsonPath(entryPointArguments.value)) {
	throw new Error(`Entry point arguments must be a string array or encoded JSON path, but received a non JSON path string');
	.`);
	}
	if (!this.isArrayOfStrings(entryPointArguments.value)) {
	throw new Error(`Entry point arguments must be a string array or encoded JSON path but received ${typeof entryPointArguments.value}.`);
	}
	}

Additional Information/Context

No response

CDK CLI Version

2.28.1 (build d035432)

Framework Version

2.28.1

Node.js Version

v14.17.0

OS

MacOS Big Sur

Language

Typescript

Language Version

No response

Other information

No response

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.