Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

r/aws_kinesis_firehose_delivery_stream: Unexpected diffs for extended_s3_configuration.processing_configuration.processors.parameters #35669

Closed
ewbankkit opened this issue Feb 6, 2024 · 3 comments · Fixed by #35672
Labels
bug Addresses a defect in current functionality. service/firehose Issues and PRs that pertain to the firehose service. service/iam Issues and PRs that pertain to the iam service. service/lambda Issues and PRs that pertain to the lambda service. service/s3 Issues and PRs that pertain to the s3 service.
Milestone

Comments

@ewbankkit
Copy link
Contributor

ewbankkit commented Feb 6, 2024

Apply:

terraform {
  required_providers {
    aws = {
      source = "hashicorp/aws"
      version = "5.32.0"
    }
  }
}

provider "aws" {
   region = "eu-north-1"
}


resource "aws_kinesis_firehose_delivery_stream" "extended_s3_stream" {
  name        = "terraform-kinesis-firehose-extended-s3-test-stream"
  destination = "extended_s3"

  extended_s3_configuration {
    role_arn   = aws_iam_role.firehose_role.arn
    bucket_arn = aws_s3_bucket.bucket.arn

    processing_configuration {
      enabled = "true"

      processors {
        type = "Lambda"

        parameters {
          parameter_name  = "LambdaArn"
          parameter_value = "${aws_lambda_function.lambda_processor.arn}:$LATEST"
        }
        parameters {
          parameter_name  = "BufferIntervalInSeconds"
          parameter_value = "180"
        }
        parameters {
          parameter_name  = "BufferSizeInMBs"
          parameter_value = 3.0
        }
      }
    }
  }
}

resource "aws_s3_bucket" "bucket" {
  bucket = "tf-test-bucket-patrick2"
}

resource "aws_iam_role" "firehose_role" {
  name = "firehose_test_role"

  assume_role_policy = <<EOF
{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Action": "sts:AssumeRole",
      "Principal": {
        "Service": "firehose.amazonaws.com"
      },
      "Effect": "Allow",
      "Sid": ""
    }
  ]
}
EOF
}

resource "aws_iam_role" "lambda_iam" {
  name = "lambda_iam"

  assume_role_policy = <<EOF
{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Action": "sts:AssumeRole",
      "Principal": {
        "Service": "lambda.amazonaws.com"
      },
      "Effect": "Allow",
      "Sid": ""
    }
  ]
}
EOF
}

resource "aws_lambda_function" "lambda_processor" {
  filename      = "example.zip"
  function_name = "patrick-test"
  role          = aws_iam_role.lambda_iam.arn
  handler       = "exports.handler"
  runtime       = "python3.9"
}

Subsequent Plans:

  # aws_kinesis_firehose_delivery_stream.extended_s3_stream will be updated in-place
  ~ resource "aws_kinesis_firehose_delivery_stream" "extended_s3_stream" {
        id             = "arn:aws:firehose:eu-north-1:123456789012:deliverystream/terraform-kinesis-firehose-extended-s3-test-stream"
        name           = "terraform-kinesis-firehose-extended-s3-test-stream"
        tags           = {}
        # (5 unchanged attributes hidden)

      ~ extended_s3_configuration {
            # (6 unchanged attributes hidden)

          ~ processing_configuration {
                # (1 unchanged attribute hidden)

              ~ processors {
                    # (1 unchanged attribute hidden)

                  ~ parameters {
                      ~ parameter_name  = "BufferSizeInMBs" -> "BufferIntervalInSeconds"
                      ~ parameter_value = "3" -> "180"
                    }
                  ~ parameters {
                      ~ parameter_name  = "BufferIntervalInSeconds" -> "BufferSizeInMBs"
                      ~ parameter_value = "180" -> "3"

Relates #19936.

Copy link

github-actions bot commented Feb 6, 2024

Community Note

Voting for Prioritization

  • Please vote on this issue by adding a 👍 reaction to the original post to help the community and maintainers prioritize this request.
  • Please see our prioritization guide for information on how we prioritize.
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request.

Volunteering to Work on This Issue

  • If you are interested in working on this issue, please leave a comment.
  • If this would be your first contribution, please review the contribution guide.

@ewbankkit ewbankkit changed the title r/aws_kinesis_firehose_delivery_stream: Unexpected diffs for extended_s3_configuration.processing_configuration.processors.parameters r/aws_kinesis_firehose_delivery_stream: Unexpected diffs for extended_s3_configuration.processing_configuration.processors.parameters Feb 6, 2024
@github-actions github-actions bot added service/firehose Issues and PRs that pertain to the firehose service. service/iam Issues and PRs that pertain to the iam service. service/lambda Issues and PRs that pertain to the lambda service. service/s3 Issues and PRs that pertain to the s3 service. labels Feb 6, 2024
@ewbankkit ewbankkit added bug Addresses a defect in current functionality. and removed service/lambda Issues and PRs that pertain to the lambda service. service/iam Issues and PRs that pertain to the iam service. service/s3 Issues and PRs that pertain to the s3 service. labels Feb 6, 2024
@github-actions github-actions bot added service/iam Issues and PRs that pertain to the iam service. service/lambda Issues and PRs that pertain to the lambda service. service/s3 Issues and PRs that pertain to the s3 service. labels Feb 6, 2024
@github-actions github-actions bot added this to the v5.36.0 milestone Feb 6, 2024
Copy link

github-actions bot commented Feb 8, 2024

This functionality has been released in v5.36.0 of the Terraform AWS Provider. Please see the Terraform documentation on provider versioning or reach out if you need any assistance upgrading.

For further feature requests or bug reports with this functionality, please create a new GitHub issue following the template. Thank you!

Copy link

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Mar 10, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Addresses a defect in current functionality. service/firehose Issues and PRs that pertain to the firehose service. service/iam Issues and PRs that pertain to the iam service. service/lambda Issues and PRs that pertain to the lambda service. service/s3 Issues and PRs that pertain to the s3 service.
Projects
None yet
1 participant