Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No AWS FSx Lustre PERSISTENT_2 data association parameter #22656

Closed
olileach opened this issue Jan 19, 2022 · 3 comments
Closed

No AWS FSx Lustre PERSISTENT_2 data association parameter #22656

olileach opened this issue Jan 19, 2022 · 3 comments
Labels
enhancement Requests to existing resources that expand the functionality or scope. service/fsx Issues and PRs that pertain to the fsx service.

Comments

@olileach
Copy link

olileach commented Jan 19, 2022

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Terraform CLI and Terraform AWS Provider Version

➜ terraform terraform -v
Terraform v1.1.2
on darwin_arm64
provider registry.terraform.io/hashicorp/aws v3.72.0

Affected Resource(s)

  • aws_fsx_lustre_file_system

Terraform Configuration Files

terraform {
  required_providers {
    aws = {
      source  = "hashicorp/aws"
      version = "3.72.0"
    }
  }
}

# Configure the AWS Provider
provider "aws" {
  region = "us-east-1"
}

resource "aws_fsx_lustre_file_system" "fsx-filesystem-1" {
  import_path      = "s3://bucket-us-east-1"
  storage_capacity = 1200
  storage_type = "SSD"
  per_unit_storage_throughput = "125"
  deployment_type = "PERSISTENT_2"
  subnet_ids       = ["subnet-xxxxx"]
}

Debug Output

aws_fsx_lustre_file_system.fsx-filesystem-1: Creating...
╷
│ Error: error creating FSx Lustre File System: BadRequest: Linking a Persistent 2 file system to an S3 bucket using the LustreConfiguraton is not supported. Create a file system and then create a data repository association to link S3 buckets to the file system. For more details, visit https://docs.aws.amazon.com/fsx/latest/LustreGuide/create-dra-linked-data-repo.html
│
│   with aws_fsx_lustre_file_system.fsx-filesystem-1,
│   on fsx.tf line 15, in resource "aws_fsx_lustre_file_system" "fsx-filesystem-1":
│   15: resource "aws_fsx_lustre_file_system" "fsx-filesystem-1" {
│
╵

Expected Behavior

I am trying to deploy an AWS FSX PERSISTENT_2 file system. PERSISTENT_2 was released in Nov 2021 and is built on Lustre v2.12 and offers higher PerUnitStorageThroughput.

However, I need to create a data repository association with the PERSISTENT_2 filesystem but can't using the v3.72.0 AWS provider. The import_path parameter is not compatible with PERSISTENT_2 and there are no other parameters I can use to create the data repository association.

Actual Behavior

The deployment fails if I use import_path using PERSISTENT_2. If I remove the import_path parameter, I get a PERSISTENT_2 filesystem that uses Lustre version 2.12. However, there is no way, using the AWS provider v3.72.0, to create a data reposiotry association so I cannot import files to FSx from S3.

Steps to Reproduce

  1. Take the example tf file above that include the import_path parameter
  2. terraform plan | apply
  3. The deployment will fail with the error above
  4. remove the import_path
  5. The deployment will work and deploy a lustre 2.12 filesystem but without the data repository association

References

https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-fsx-lustre-file-systems/

@github-actions github-actions bot added needs-triage Waiting for first response or review from a maintainer. service/fsx Issues and PRs that pertain to the fsx service. labels Jan 19, 2022
@DrFaust92
Copy link
Collaborator

#22291 Related

@DrFaust92 DrFaust92 added enhancement Requests to existing resources that expand the functionality or scope. and removed needs-triage Waiting for first response or review from a maintainer. labels Jan 19, 2022
@breathingdust
Copy link
Member

Closed in v3.73.0 🎉

@github-actions
Copy link

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 18, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement Requests to existing resources that expand the functionality or scope. service/fsx Issues and PRs that pertain to the fsx service.
Projects
None yet
Development

No branches or pull requests

3 participants