[error] [http_client] broken connection to

[divyank-gupta-sp]

Bug Report

Describe the bug

2024/04/15 15:00:49] [debug] [output:http:http.0] task_id=1 assigned to thread #1
[2024/04/15 15:00:49] [debug] [output:http:http.0] task_id=5 assigned to thread #0
[2024/04/15 15:00:49] [debug] [output:http:http.0] signing request with AWS Sigv4
[2024/04/15 15:00:49] [debug] [output:http:http.0] signing request with AWS Sigv4
[2024/04/15 15:00:49] [error] [http_client] broken connection to lpm-poc-1-icuskdgqpklye24nxu4jl55x4a.us-east-2.osis.amazonaws.com:443 ?
[2024/04/15 15:00:49] [error] [output:http:http.0] could not flush records to lpm-poc-1-icuskdgqpklye24nxu4jl55x4a.us-east-2.osis.amazonaws.com:443 (http_do=-1)
[2024/04/15 15:00:49] [ warn] [engine] chunk '1-1713193230.878240317.flb' cannot be retried: task_id=4, input=dummy.0 > output=http.0

To Reproduce

• https://docs.aws.amazon.com/opensearch-service/latest/developerguide/configure-client-fluentbit.html

FluentBit Config:

    [INPUT]
      Name dummy
      Dummy {"top": {".dotted": "value"}}
    [OUTPUT]

      Name http
      Match *
      Host lpm-poc-1-icuskdgqpklye24nxu4jl55x4a.us-east-2.osis.amazonaws.com
      Port 443
      URI /log-pipeline/logs
      Format json
      aws_auth true
      aws_region  us-east-2
      aws_service osis
      aws_role_arn arn:aws:iam::406205545357:role/LPM_POC_TEST_1
      Log_Level trace
      tls On

Opensearch Ingestion Pipeline Config:

version: "2"
log-pipeline:
  source:
    http:
      path: "/log-pipeline/logs"

  sink:
    - opensearch:
        hosts: [ "https://vpc-logs-os-useast2-lrw5t4agewuwolew2lcatgfsfy.us-east-2.es.amazonaws.com" ]
        aws:
          sts_role_arn: "arn:aws:iam::406205545357:role/AWS_OS_Pipeline_Access_POC"
          region: us-east-2
        index: "fluent-bit"

Expected behavior

Sending logs to the AWS Opensearch Ingestion Pipeline from Fluentbit

Your Environment

• Version used: Fluent Bit v1.9.10 (AWS for Fluent Bit Container Image Version 2.32.2)
• Configuration: FluentBit deployed on EKS cluster in AWS trying to send logs to AWS Opensearch Ingestion Pipeline
• Environment name and version (e.g. Kubernetes? What version?):EKS 1.25
• Filters and plugins: FluentBit http Output plugin

Additional context

FluentBit deployed on EKS cluster in AWS trying to send logs to AWS Opensearch Ingestion Pipeline

[edsiper]

Please attach the full log

[github-actions]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

[github-actions]

This issue was closed because it has been stalled for 5 days with no activity.