Skip to content
This repository has been archived by the owner on Sep 21, 2023. It is now read-only.

Implement an MVP of the Elasticsearch output #10

Closed
Tracked by #197
cmacknz opened this issue Mar 17, 2022 · 5 comments · Fixed by #137
Closed
Tracked by #197

Implement an MVP of the Elasticsearch output #10

cmacknz opened this issue Mar 17, 2022 · 5 comments · Fixed by #137
Assignees
Labels
estimation:Week Task that represents a week of work. Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team v8.5.0 v8.6.0

Comments

@cmacknz
Copy link
Member

cmacknz commented Mar 17, 2022

Once #7 is complete, implement basic support for the Elasticsearch output.

The simplest solution is to use the existing beats Elasticsearch output, but we should evaluate the effort required to switch to the official go-elasticsearch client (#14) with the initial output. If the effort is too high then switching the underlying Elasticsearch client can be deferred into a future iteration.

This feature is considered complete when at least the following criteria are satisfied:

  • A test exists proving that an Elasticsearch output can be configured, and data published to the shipper is written to Elasticsearch.
@nimarezainia
Copy link

@cmacknz @jlind23 will this be targeted for 8.4?

@jlind23
Copy link
Contributor

jlind23 commented Apr 25, 2022

@nimarezainia this is something we may need for 8.3 in order to have the shippers properly working with an output.

@cmacknz cmacknz added the v8.4.0 label Apr 25, 2022
@cmacknz
Copy link
Member Author

cmacknz commented Apr 25, 2022

I targeted it to 8.4. We might start it sooner though if we need it as Julien noted.

@jlind23
Copy link
Contributor

jlind23 commented Oct 4, 2022

@faec any update here?

@jlind23 jlind23 linked a pull request Oct 17, 2022 that will close this issue
@cmacknz
Copy link
Member Author

cmacknz commented Oct 18, 2022

Let's rescope this to just producing an MVP Elasticsearch output that allows a Beat to publish events through the shipper to a single datastream index. We will create follow up issues for the remaining features.

In the initial version we can assume the Elasticsearch output in the agent policy is trivial, like the basic example from https://www.elastic.co/guide/en/fleet/current/elasticsearch-output.html

outputs:
  default:
    type: elasticsearch
    hosts: [127.0.0.1:9200]
    username: elastic
    password: changeme

@cmacknz cmacknz changed the title Implement the Elasticsearch output Implement an MVP of the Elasticsearch output Oct 18, 2022
@faec faec closed this as completed in #137 Oct 27, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
estimation:Week Task that represents a week of work. Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team v8.5.0 v8.6.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants