otel: add cumulativetodeltaprocessor to EDOT collector #8372

anuraaga · 2025-06-06T02:36:02Z

What does this PR do?

Adds cumulativetodeltaprocessor to the EDOT collector

elastic-agent version of elastic/opentelemetry-collector-components#601

Why is it important?

Elastic stack only supports delta metrics. The processor can be used to still ingest certain cumulative metrics such as those scraped from Prometheus endpoints.

Checklist

I have read and understood the pull request guidelines of this project.
My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in ./changelog/fragments using the changelog tool
I have added an integration test or an E2E test

Disruptive User Impact

How to test this PR locally

Can start a server exposing Prometheus metrics such as envoy and configure collector with prometheus receiver and cumulativetodelta processor to elastic apm.

mergify · 2025-06-06T02:36:41Z

This pull request does not have a backport label. Could you fix it @anuraaga? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

backport-./d./d is the label that automatically backports to the 8./d branch. /d is the digit
backport-active-all is the label that automatically backports to all active branches.
backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

elasticmachine · 2025-06-06T07:04:02Z

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

mergify · 2025-06-06T07:17:24Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b cumulativetodelta upstream/cumulativetodelta
git merge upstream/main
git push upstream cumulativetodelta

…cumulativetodelta

changelog/fragments/1749176965-add-cumulativetodeltaprocessor.yaml

andrzej-stencel

I've allowed myself to add tests and update the changelog fragment.

elastic-sonarqube · 2025-06-06T12:21:52Z

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube

elasticmachine · 2025-06-06T12:57:33Z

💚 Build Succeeded

Buildkite Build
Commit: 139d54a

History

💚 Build #21947 succeeded 9b322c1
💚 Build #21929 succeeded c56f450
💔 Build #21927 failed 0025ea4

cc @anuraaga

codefromthecrypt · 2025-06-06T23:07:28Z

thanks @anuraaga!

github-actions · 2025-06-06T23:07:33Z

@Mergifyio backport 8.17 8.18 8.19 9.0

mergify · 2025-06-06T23:07:56Z

backport 8.17 8.18 8.19 9.0

✅ Backports have been created

#8385 [8.17] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector has been created for branch 8.17 but encountered conflicts
#8386 [8.18] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector has been created for branch 8.18 but encountered conflicts
#8387 [8.19] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector has been created for branch 8.19
#8388 [9.0] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector has been created for branch 9.0 but encountered conflicts

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970) # Conflicts: # NOTICE-fips.txt # go.mod # go.sum # internal/pkg/otel/README.md # internal/pkg/otel/components.go # internal/pkg/otel/testdata/all-components-fips.yml

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970) # Conflicts: # NOTICE-fips.txt # go.mod # go.sum # internal/pkg/otel/README.md # internal/pkg/otel/testdata/all-components-fips.yml

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970)

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970) # Conflicts: # NOTICE-fips.txt # go.mod # go.sum # internal/pkg/otel/README.md # internal/pkg/otel/testdata/all-components-fips.yml

--------- (cherry picked from commit 5111970) Co-authored-by: Anuraag (Rag) Agrawal <anuraaga@gmail.com> Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co>

…collector (#8385) * otel: add cumulativetodeltaprocessor to EDOT collector (#8372) --------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970) # Conflicts: # NOTICE-fips.txt # go.mod # go.sum # internal/pkg/otel/README.md # internal/pkg/otel/components.go # internal/pkg/otel/testdata/all-components-fips.yml * Fix merge * Fix merge more --------- Co-authored-by: Anuraag (Rag) Agrawal <anuraaga@gmail.com>

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co>

…collector (#8386) * otel: add cumulativetodeltaprocessor to EDOT collector (#8372) --------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970) # Conflicts: # NOTICE-fips.txt # go.mod # go.sum # internal/pkg/otel/README.md # internal/pkg/otel/testdata/all-components-fips.yml * Fix merge * mage notice --------- Co-authored-by: Anuraag (Rag) Agrawal <anuraaga@gmail.com> Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co>

…ollector (#8388) * otel: add cumulativetodeltaprocessor to EDOT collector (#8372) --------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970) # Conflicts: # NOTICE-fips.txt # go.mod # go.sum # internal/pkg/otel/README.md # internal/pkg/otel/testdata/all-components-fips.yml * Fix merge * Remove non-existing --------- Co-authored-by: Anuraag (Rag) Agrawal <anuraaga@gmail.com>

…ts-oblt-cli * feature/serverless-its-oblt-cli: (51 commits) as agreed let's move the group to the kb.integration pipeline Update .github/workflows/serverless-project.yml ci: invoke serverless integration tests package from BK github-actions: create a serverless project daily [tests] split up serverless and resource leaks integration tests (#8396) chore: Update to elastic/beats@dfdc12e33de0 (#8446) Lock upgrade marker (#8254) build(deps): bump github.com/elastic/elastic-agent-system-metrics from 0.11.12 to 0.11.13 (#8420) Add docker image name template and renamed fips cloud specs (#8429) buildkite(scripts): refactor common scripts (#8365) Use require.Eventually to try and address flakiness (#8421) Fix pre-command to support extended testing (#8418) [Automation] Bump Golang version to 1.24.4 (#8384) chore: Update to elastic/beats@aed2a8b768bd (#8423) [main][Automation] Update versions (#8425) Add Pipeline to deploy custom agent image for FIPS testing (#8035) ci: automatically update OTel components (#8288) [Automation] Bump VM Image version to 1749258065 (#8390) fix: increase context timeout to accommodate for slower machines in Test_checkForUnprivilegedVault (#8374) otel: add cumulativetodeltaprocessor to EDOT collector (#8372) ...

otel: add cumulativetodeltaprocessor to EDOT collector

0025ea4

anuraaga requested a review from a team as a code owner June 6, 2025 02:36

anuraaga added the enhancement New feature or request label Jun 6, 2025

anuraaga requested review from michalpristas and swiatekm June 6, 2025 02:36

mergify bot assigned anuraaga Jun 6, 2025

anuraaga added the backport-active-all Automated backport with mergify to all the active branches label Jun 6, 2025

anuraaga added 2 commits June 6, 2025 11:55

Fix README typo

bc01911

git add changelog update

c56f450

pierrehilbert added the Team:Elastic-Agent-Control-Plane Label for the Agent Control Plane team label Jun 6, 2025

codefromthecrypt mentioned this pull request Jun 6, 2025

archgw: adds prometheus to elastic pump elastic/observability-examples#76

Merged

anuraaga added 3 commits June 6, 2025 17:09

Merge branch 'main' of https://github.com/elastic/elastic-agent into …

7816e23

…cumulativetodelta

Fix readme link

706cba2

Update notice

9b322c1

swiatekm requested a review from a team June 6, 2025 08:54

add tests

9da2906

andrzej-stencel reviewed Jun 6, 2025

View reviewed changes

changelog/fragments/1749176965-add-cumulativetodeltaprocessor.yaml Outdated Show resolved Hide resolved

set component to elastic-agent in changelog fragment

139d54a

andrzej-stencel approved these changes Jun 6, 2025

View reviewed changes

swiatekm approved these changes Jun 6, 2025

View reviewed changes

codefromthecrypt merged commit 5111970 into elastic:main Jun 6, 2025
11 checks passed

mergify bot mentioned this pull request Jun 6, 2025

[8.17] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector #8385

Merged

8 tasks

mergify bot mentioned this pull request Jun 6, 2025

[8.18] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector #8386

Merged

8 tasks

mergify bot pushed a commit that referenced this pull request Jun 6, 2025

otel: add cumulativetodeltaprocessor to EDOT collector (#8372)

20feabb

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co> (cherry picked from commit 5111970)

mergify bot mentioned this pull request Jun 6, 2025

[8.19] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector #8387

Merged

8 tasks

mergify bot mentioned this pull request Jun 6, 2025

[9.0] (backport #8372) otel: add cumulativetodeltaprocessor to EDOT collector #8388

Merged

8 tasks

michel-laterman pushed a commit to michel-laterman/elastic-agent that referenced this pull request Jun 9, 2025

otel: add cumulativetodeltaprocessor to EDOT collector (elastic#8372)

dcb0047

--------- Co-authored-by: Andrzej Stencel <andrzej.stencel@elastic.co>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

otel: add cumulativetodeltaprocessor to EDOT collector #8372

otel: add cumulativetodeltaprocessor to EDOT collector #8372

Uh oh!

anuraaga commented Jun 6, 2025

Uh oh!

mergify bot commented Jun 6, 2025

Uh oh!

elasticmachine commented Jun 6, 2025

Uh oh!

mergify bot commented Jun 6, 2025

Uh oh!

Uh oh!

andrzej-stencel left a comment

Uh oh!

elastic-sonarqube bot commented Jun 6, 2025

Uh oh!

elasticmachine commented Jun 6, 2025

Uh oh!

Uh oh!

codefromthecrypt commented Jun 6, 2025

Uh oh!

github-actions bot commented Jun 6, 2025

Uh oh!

mergify bot commented Jun 6, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

otel: add cumulativetodeltaprocessor to EDOT collector #8372

otel: add cumulativetodeltaprocessor to EDOT collector #8372

Uh oh!

Conversation

anuraaga commented Jun 6, 2025

What does this PR do?

Why is it important?

Checklist

Disruptive User Impact

How to test this PR locally

Uh oh!

mergify bot commented Jun 6, 2025

Uh oh!

elasticmachine commented Jun 6, 2025

Uh oh!

mergify bot commented Jun 6, 2025

Uh oh!

Uh oh!

andrzej-stencel left a comment

Choose a reason for hiding this comment

Uh oh!

elastic-sonarqube bot commented Jun 6, 2025

Quality Gate passed

Uh oh!

elasticmachine commented Jun 6, 2025

💚 Build Succeeded

History

Uh oh!

Uh oh!

codefromthecrypt commented Jun 6, 2025

Uh oh!

github-actions bot commented Jun 6, 2025

Uh oh!

mergify bot commented Jun 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Backports have been created

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

mergify bot commented Jun 6, 2025 •

edited

Loading