-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Filebeat] Support mixed line terminators #32925
Comments
Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane) |
Hi! We're labeling this issue as |
Describe the enhancement:
By #5500 and PR #11015, filebeat started supporting line terminator config by choosing only one from candidate values like
carriage_return
,line_feed
, etc. IMHO it would be much better to specify line terminator by regex or at least choosing multiple/mixed predefined options like\r or \r\n or \n
.Describe a specific use case for the enhancement or feature:
I'm using filebeat in k8s to gather logs from pods. In these pods there are logs generated by progressbar tools like tqdm that uses
\r
to separate progress messages. Instead of reading each of these progress messages as a separated line, filebeat's harvester gather all progresses as a whole, so that output is not sending in real time to downstream elasticsearch. If I configure the line terminator as\r
, the harvester no longer works with normal logs ended by\n
.The text was updated successfully, but these errors were encountered: