Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Filebeat] Support mixed line terminators #32925

Closed
phamour opened this issue Aug 30, 2022 · 2 comments
Closed

[Filebeat] Support mixed line terminators #32925

phamour opened this issue Aug 30, 2022 · 2 comments
Labels
Stalled Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team

Comments

@phamour
Copy link

phamour commented Aug 30, 2022

Describe the enhancement:
By #5500 and PR #11015, filebeat started supporting line terminator config by choosing only one from candidate values like carriage_return, line_feed, etc. IMHO it would be much better to specify line terminator by regex or at least choosing multiple/mixed predefined options like \r or \r\n or \n.

Describe a specific use case for the enhancement or feature:
I'm using filebeat in k8s to gather logs from pods. In these pods there are logs generated by progressbar tools like tqdm that uses \r to separate progress messages. Instead of reading each of these progress messages as a separated line, filebeat's harvester gather all progresses as a whole, so that output is not sending in real time to downstream elasticsearch. If I configure the line terminator as \r, the harvester no longer works with normal logs ended by \n.

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Aug 30, 2022
@mtojek mtojek added the Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team label Sep 5, 2022
@elasticmachine
Copy link
Collaborator

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Sep 5, 2022
@botelastic
Copy link

botelastic bot commented Sep 5, 2023

Hi!
We just realized that we haven't looked into this issue in a while. We're sorry!

We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1.
Thank you for your contribution!

@botelastic botelastic bot added the Stalled label Sep 5, 2023
@botelastic botelastic bot closed this as completed Mar 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Stalled Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team
Projects
None yet
Development

No branches or pull requests

3 participants