Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lake Formation Permissions #13396

Merged
merged 31 commits into from
Dec 18, 2020

Conversation

gmazelier
Copy link
Contributor

@gmazelier gmazelier commented May 19, 2020

Community Note

  • Please vote on this pull request by adding a 👍 reaction to the original pull request comment to help the community and maintainers prioritize this request
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for pull request followers and do not help prioritize the request

Relates #9700
Depends on #13250 and #13267

AWS Lake Formation support: manages the permissions that a principal has on an AWS Glue Data Catalog resource (such as AWS Glue database or AWS Glue tables).

Release note for CHANGELOG:

* **New Resource**: `aws_lakeformation_permissions` (#13396)

Output from acceptance testing:

$ make testacc TEST=./aws TESTARGS='-run=TestAccAWSLakeFormationPerm'
==> Checking that code complies with gofmt requirements...
TF_ACC=1 go test ./aws -v -count 1 -parallel 20 -run=TestAccAWSLakeFormationPerm -timeout 120m
=== RUN   TestAccAWSLakeFormationPermissions_full
=== PAUSE TestAccAWSLakeFormationPermissions_full
=== CONT  TestAccAWSLakeFormationPermissions_full
--- PASS: TestAccAWSLakeFormationPermissions_full (210.49s)
PASS
ok  	github.com/terraform-providers/terraform-provider-aws/aws	211.898s

@ghost ghost added size/XXL Managed by automation to categorize the size of a PR. needs-triage Waiting for first response or review from a maintainer. documentation Introduces or discusses updates to documentation. provider Pertains to the provider itself, rather than any interaction with AWS. tests PRs: expanded test coverage. Issues: expanded coverage, enhancements to test infrastructure. labels May 19, 2020
@gmazelier gmazelier marked this pull request as ready for review May 26, 2020 21:32
@gmazelier gmazelier requested a review from a team May 26, 2020 21:32
@gmazelier
Copy link
Contributor Author

@robertstettner: proposal for Lake Formation permissions support. Feedbacks are welcome :)

@kinghuang
Copy link

Is there anything the community can do to help move this and the related PRs along? I'm very eager to configure Lake Formation permissions via Terraform!

@tuannguyen0901
Copy link

Intersted in this feature as we're building data lake. Any ETA this will be released?

@breathingdust breathingdust added new-resource Introduces a new resource. service/lakeformation Issues and PRs that pertain to the lakeformation service. and removed needs-triage Waiting for first response or review from a maintainer. labels Jul 3, 2020
@teamterraform
Copy link

Notification of Recent and Upcoming Changes to Contributions

Thank you for this contribution! There have been a few recent development changes that affect this pull request. We apologize for the inconvenience, especially if there have been long review delays up until now. Please note that this is automated message from an unmonitored account. See the FAQ for additional information on the maintainer team and review prioritization.

If you are unable to complete these updates, please leave a comment for the community and maintainers so someone can potentially continue the work. The maintainers will encourage other contributors to use the existing contribution as the base for additional changes as appropriate. Otherwise, contributions that do not receive updated code or comments from the original contributor may be closed in the future so the maintainers can focus on active items.

For the most up to date information about Terraform AWS Provider development, see the Contributing Guide. Additional technical debt changes can be tracked with the technical-debt label on issues.

As part of updating a pull request with these changes, the most current unit testing and linting will run. These may report issues that were not previously reported.

Terraform 0.12 Syntax

Reference: #8950
Reference: #14417

Version 3 and later of the Terraform AWS Provider, which all existing contributions would potentially be added, only supports Terraform 0.12 and later. Certain syntax elements of Terraform 0.11 and earlier show deprecation warnings during runs with Terraform 0.12. Documentation and test configurations, such as those including deprecated string interpolations (some_attribute = "${aws_service_thing.example.id}") should be updated to the newer syntax (some_attribute = aws_service_thing.example.id). Contribution testing will automatically fail on older syntax in the near future. Please see the referenced issues for additional information.

Action Required: Terraform Plugin SDK Version 2

Reference: #14551

The Terraform AWS Provider has been upgraded to the latest version of the Terraform Plugin SDK. Generally, most changes to contributions should only involve updating Go import paths in source code files. Please see the referenced issue for additional information.

Action Required: Removal of website/aws.erb File

Reference: #14712

Any changes to the website/aws.erb file are no longer necessary and should be removed from this contribution to prevent merge issues in the near future when the file is removed from the repository. Please see the referenced issue for additional information.

Upcoming Change of Git Branch Naming

Reference: #14292

Development environments will need their upstream Git branch updated from master to main in the near future. Please see the referenced issue for additional information and scheduling.

Upcoming Change of GitHub Organization

Reference: #14715

This repository will be migrating from https://github.com/terraform-providers/terraform-provider-aws to https://github.com/hashicorp/terraform-provider-aws. No practitioner or developer action is anticipated and most GitHub functionality will automatically redirect to the new location. Go import paths including terraform-providers can remain for now. Please see the referenced issue for additional information and scheduling.

@YakDriver YakDriver self-assigned this Nov 17, 2020
@YakDriver YakDriver added the partition/aws-us-gov Pertains to the aws-us-gov partition. label Dec 4, 2020
@gmazelier gmazelier requested a review from a team as a code owner December 11, 2020 18:15
@YakDriver YakDriver changed the title Lakeformation permissions Lake Formation Permissions Dec 11, 2020
@ghost ghost added size/XL Managed by automation to categorize the size of a PR. and removed size/XXL Managed by automation to categorize the size of a PR. labels Dec 11, 2020
@YakDriver
Copy link
Member

@gmazelier I'm currently working on tweaks to this PR so please avoid changes for the next few days without giving me a heads up. Thanks for all your work on this!

@gmazelier
Copy link
Contributor Author

@YakDriver yes sure.

@YakDriver YakDriver force-pushed the lakeformation_permissions branch 2 times, most recently from 5b6e7dc to 0e63133 Compare December 18, 2020 18:41
Copy link
Member

@YakDriver YakDriver left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GovCloud acceptance tests

--- PASS: TestAccAWSLakeFormation_serial (312.87s)
    --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings (60.03s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/basic (15.79s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/disappears (14.63s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/withoutCatalogId (14.03s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/dataSource (15.58s)
    --- PASS: TestAccAWSLakeFormation_serial/Permissions (252.84s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/basic (24.38s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/database (24.02s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/dataLocationDataSource (25.12s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/tableDataSource (25.93s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/tableWithColumnsDataSource (23.38s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/dataLocation (26.07s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/table (26.22s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/tableWithColumns (22.81s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/basicDataSource (24.81s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/databaseDataSource (30.11s)
--- PASS: TestAccAWSLakeFormationResource_disappears (24.59s)
--- PASS: TestAccAWSLakeFormationResource_serviceLinkedRole (24.61s)
--- PASS: TestAccAWSLakeFormationResource_basic (24.95s)
--- PASS: TestAccAWSLakeFormationResourceDataSource_basic (26.08s)
--- PASS: TestAccAWSLakeFormationResource_updateSLRToRole (45.98s)
--- PASS: TestAccAWSLakeFormationResource_updateRoleToRole (47.16s)
PASS
ok  	github.com/terraform-providers/terraform-provider-aws/aws	361.305s

Commercial acceptance tests

--- PASS: TestAccAWSLakeFormation_serial (330.49s)
    --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings (44.39s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/withoutCatalogId (10.73s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/dataSource (11.24s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/basic (11.85s)
        --- PASS: TestAccAWSLakeFormation_serial/DataLakeSettings/disappears (10.57s)
    --- PASS: TestAccAWSLakeFormation_serial/Permissions (286.10s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/table (26.87s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/tableWithColumns (24.02s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/basicDataSource (20.32s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/dataLocationDataSource (26.85s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/databaseDataSource (25.62s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/basic (19.28s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/database (33.18s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/tableDataSource (27.81s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/tableWithColumnsDataSource (25.21s)
        --- PASS: TestAccAWSLakeFormation_serial/Permissions/dataLocation (56.93s)
--- PASS: TestAccAWSLakeFormationResource_disappears (22.29s)
--- PASS: TestAccAWSLakeFormationResource_basic (22.83s)
--- PASS: TestAccAWSLakeFormationResource_serviceLinkedRole (23.56s)
--- PASS: TestAccAWSLakeFormationResourceDataSource_basic (24.00s)
--- PASS: TestAccAWSLakeFormationResource_updateRoleToRole (40.91s)
--- PASS: TestAccAWSLakeFormationResource_updateSLRToRole (42.13s)
PASS
ok  	github.com/terraform-providers/terraform-provider-aws/aws	373.755s

@ghost
Copy link

ghost commented Dec 18, 2020

This has been released in version 3.22.0 of the Terraform AWS provider. Please see the Terraform documentation on provider versioning or reach out if you need any assistance upgrading.

For further feature requests or bug reports with this functionality, please create a new GitHub issue following the template for triage. Thanks!

@ghost
Copy link

ghost commented Jan 18, 2021

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. Thanks!

@ghost ghost locked as resolved and limited conversation to collaborators Jan 18, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
documentation Introduces or discusses updates to documentation. new-resource Introduces a new resource. partition/aws-us-gov Pertains to the aws-us-gov partition. provider Pertains to the provider itself, rather than any interaction with AWS. service/lakeformation Issues and PRs that pertain to the lakeformation service. size/XXL Managed by automation to categorize the size of a PR. tests PRs: expanded test coverage. Issues: expanded coverage, enhancements to test infrastructure.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants