Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Remove hardcoded service limits on AWS Glue Jobs parameters #4331

Closed
TLipede opened this issue Apr 24, 2018 · 4 comments · Fixed by #4461
Closed

Bug: Remove hardcoded service limits on AWS Glue Jobs parameters #4331

TLipede opened this issue Apr 24, 2018 · 4 comments · Fixed by #4461
Labels
bug Addresses a defect in current functionality. service/glue Issues and PRs that pertain to the glue service.
Milestone

Comments

@TLipede
Copy link

TLipede commented Apr 24, 2018

Terraform Version

Terraform v0.11.7

Affected Resource(s)

  • aws_glue_job

Terraform Configuration Files

resource "aws_glue_job" "glue-jobs" {
  count = "${length(var.glue_jobs)}"

  name               = "${var.glue_jobs[count.index]}"
  allocated_capacity = 150
  execution_property = {
    max_concurrent_runs = 10
  }
  role_arn           = "${aws_iam_role.glue-jobs.arn}"
}

Expected Behavior

Terraform should attempt to create a job with the parameters provided, without taking into account the default upper service limits (as these can be increased).

Actual Behavior

The allocated_capacity and max_concurrent_runs parameters are restricted to a maximum of 100 and 3 respectively.

References

https://docs.aws.amazon.com/glue/latest/dg/troubleshooting-service-limits.html

@catsby catsby added bug Addresses a defect in current functionality. service/glue Issues and PRs that pertain to the glue service. labels Apr 24, 2018
@TLipede TLipede changed the title Feature Request: Remove hardcoded service limits on AWS Glue Jobs parameters Bug: Remove hardcoded service limits on AWS Glue Jobs parameters Apr 25, 2018
@bflad bflad added this to the v1.18.0 milestone May 5, 2018
@bflad
Copy link
Contributor

bflad commented May 5, 2018

Bug fix PR submitted: #4461

@bflad
Copy link
Contributor

bflad commented May 9, 2018

The fix for these two attributes will go out later today with the v1.18.0 release of the AWS provider.

@bflad
Copy link
Contributor

bflad commented May 10, 2018

This has been released in version 1.18.0 of the AWS provider. Please see the Terraform documentation on provider versioning or reach out if you need any assistance upgrading.

@ghost
Copy link

ghost commented Apr 6, 2020

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. Thanks!

@ghost ghost locked and limited conversation to collaborators Apr 6, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Addresses a defect in current functionality. service/glue Issues and PRs that pertain to the glue service.
Projects
None yet
3 participants