Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

processing_configuration not available for AWS Elasticsearch Firehose Delivery Stream #16963

Closed
jmlw opened this issue Dec 20, 2017 · 2 comments

Comments

@jmlw
Copy link

jmlw commented Dec 20, 2017

Terraform Version

Terraform v0.11.1
* provider.aws: version = "~> 1.6"
* provider.template: version = "~> 1.0"

Terraform Configuration Files

resource "aws_kinesis_firehose_delivery_stream" "elasticsearch_ingestion_stream" {
  name        = "elasticsearch_ingestion_stream"
  destination = "elasticsearch"

  kinesis_source_configuration {
    kinesis_stream_arn = "kinesis-stream-arn"
    role_arn           = "firehose_iam_role"
  }

  s3_configuration {
    role_arn           = "firehose-iam-role"
    bucket_arn         = "arn:aws:s3:::bucket"
    prefix             = "logs/logs"
    buffer_size        = 10
    buffer_interval    = 400
    compression_format = "GZIP"
  }

  elasticsearch_configuration {
    domain_arn = "domain"
    role_arn   = "role"
    index_name = "index"
    type_name  = "doc_type"
    buffering_interval = 60
    index_rotation_period = "OneDay"
    retry_duration = 900
  }
}
resource "aws_kinesis_firehose_delivery_stream" "s3_ingestion_stream" {
  name        = "s3_ingestion_stream"
  destination = "extended_s3"

  kinesis_source_configuration {
    kinesis_stream_arn = "kinesis-stream-arn"
    role_arn           = "firehose_iam_role"
  }

  extended_s3_configuration {
    role_arn                 = "firehost_iam_role"
    bucket_arn               = "arn:aws:s3:::bucket"
    prefix                   = "logs/logs"
    processing_configuration = [
      {
        enabled = "true"
        processors = [
          {
            type = "Lambda"
            parameters = [
              {
                parameter_name  = "LambdaArn"
                parameter_value = "transformer_lambda"
              }
            ]
          }
        ]
      }
    ]
  }
}

Debug Output

Not applicable

Crash Output

Not Applicable

Expected Behavior

Should be able to define lambda transformer for Elasticsearch destination the same way a processor can be defined for extended s3 destinations

Actual Behavior

processing_configuration is not a valid key for elasticsearch_configuration and is not available under any other key

@hashibot
Copy link
Contributor

This issue has been automatically migrated to hashicorp/terraform-provider-aws#2729 because it looks like an issue with that provider. If you believe this is not an issue with the provider, please reply to this issue and let us know.

@ghost
Copy link

ghost commented Apr 5, 2020

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@ghost ghost locked and limited conversation to collaborators Apr 5, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants