Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[processor/logdedup] Add include_fields option #37219

Merged
merged 9 commits into from
Jan 21, 2025

Conversation

mauri870
Copy link
Contributor

@mauri870 mauri870 commented Jan 14, 2025

Link to tracking issue

Fixes #36965

Testing

Added tests that validate the new include_fields option as well as integration tests with ConsumeLogs.

Documentation

Added documentation for the new include_fields option as well as a README example.

Copy link
Member

@MikeGoldsmith MikeGoldsmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall I like the idea but think it would be better to use a set of keys instead of just one.

processor/logdedupprocessor/README.md Outdated Show resolved Hide resolved
@mauri870 mauri870 changed the title [processor/logdedup] Add option to use a specific field as deduplication key [processor/logdedup] Add include_fields option Jan 16, 2025
@mauri870 mauri870 marked this pull request as ready for review January 16, 2025 19:51
@mauri870 mauri870 requested a review from a team as a code owner January 16, 2025 19:51
Copy link
Member

@MikeGoldsmith MikeGoldsmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look good, thanks for your work on this @mauri870. I've left some minor feedback but think it's close 👍🏻

.chloggen/logdedupprocessor-deduplication-key.yaml Outdated Show resolved Hide resolved
processor/logdedupprocessor/README.md Outdated Show resolved Hide resolved
processor/logdedupprocessor/config.go Outdated Show resolved Hide resolved
processor/logdedupprocessor/counter.go Outdated Show resolved Hide resolved
mauri870 and others added 4 commits January 20, 2025 08:28
Co-authored-by: Mike Goldsmith <goldsmith.mike@gmail.com>
Co-authored-by: Mike Goldsmith <goldsmith.mike@gmail.com>
Co-authored-by: Mike Goldsmith <goldsmith.mike@gmail.com>
Copy link
Member

@MikeGoldsmith MikeGoldsmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good for me. Any feedback from you @djaglowski?

@djaglowski djaglowski merged commit be6c7a5 into open-telemetry:main Jan 21, 2025
164 checks passed
@github-actions github-actions bot added this to the next release milestone Jan 21, 2025
chengchuanpeng pushed a commit to chengchuanpeng/opentelemetry-collector-contrib that referenced this pull request Jan 26, 2025
#### Link to tracking issue

Fixes open-telemetry#36965

<!--Describe what testing was performed and which tests were added.-->
#### Testing

Added tests that validate the new `include_fields` option as well as
integration tests with ConsumeLogs.

<!--Describe the documentation added.-->
#### Documentation

Added documentation for the new `include_fields` option as well as a
README example.

---------

Co-authored-by: Mike Goldsmith <goldsmith.mike@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[processor/logdedup] Use a specific field as deduplication key
4 participants