Skip to content

Conversation

@crespocarlos
Copy link
Contributor

@crespocarlos crespocarlos commented Jul 25, 2025

closes #226333

Summary

This PR adds Otel system metrics Lens formulas and enables them on the hosts view

ecs:

image image image image

semconv:

image image image image

Note

Disk Space Available metric value is not the same between otel and semconv, and that is because of the difference in how the filesystem scrapper collects the same data
Here is the data broken down by mount point to help understand what happens

otel beats
image image

How to test:

@crespocarlos crespocarlos force-pushed the 226333-otel-metric-charts branch from 5a41e2d to 42b69a0 Compare July 28, 2025 12:15
@crespocarlos crespocarlos force-pushed the 226333-otel-metric-charts branch from 42b69a0 to a44e422 Compare July 28, 2025 12:17
@crespocarlos crespocarlos added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team v9.2.0 labels Jul 28, 2025
@crespocarlos crespocarlos changed the title 226333 otel metric charts [Infra] Add OTel metric charts to Hosts View Jul 28, 2025
@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
infra 1.0MB 1.0MB +486.0B
metricsDataAccess 73.1KB 78.7KB +5.5KB
total +6.0KB

Public APIs missing exports

Total count of every type that is part of your API that should be exported but is not. This will cause broken links in the API documentation system. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats exports for more detailed information.

id before after diff
metricsDataAccess 4 5 +1

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
metricsDataAccess 38.0KB 38.3KB +284.0B

History

@crespocarlos crespocarlos marked this pull request as ready for review July 29, 2025 07:28
@crespocarlos crespocarlos requested a review from a team as a code owner July 29, 2025 07:28
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)


const items = overview
? [kibernetesNode.xy.nodeCpuCapacity, kibernetesNode.xy.nodeMemoryCapacity]
? [kubernetesNode.xy.nodeCpuCapacity, kubernetesNode.xy.nodeMemoryCapacity]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Omg, good catch, how long have we been with this typo? 😄

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks to Windsurf 😆 . It would've passed unnoticed again if it weren't for it.

Copy link
Contributor

@MiriamAparicio MiriamAparicio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing, semconv formulas are quite complex, so I believe are right :)

@crespocarlos crespocarlos enabled auto-merge (squash) July 29, 2025 10:45
@crespocarlos crespocarlos merged commit bd516ff into elastic:main Jul 29, 2025
12 checks passed
@crespocarlos crespocarlos deleted the 226333-otel-metric-charts branch July 29, 2025 11:56
VladimirFilonov pushed a commit to VladimirFilonov/kibana that referenced this pull request Jul 30, 2025
closes [elastic#226333](elastic#226333)

## Summary

This PR adds Otel system metrics Lens formulas and enables them on the
hosts view



**ecs:**

<img width="900" height="645" alt="image"
src="https://github.com/user-attachments/assets/e79ac886-f398-41d4-99a3-eaeeeb598596"
/>

<img width="900" height="615" alt="image"
src="https://github.com/user-attachments/assets/586a6793-d536-4f0e-8ed5-6a9cc801e1ca"
/>

<img width="900" height="501" alt="image"
src="https://github.com/user-attachments/assets/fc52ea34-62e2-4c31-89b2-e1e2185849c8"
/>

<img width="900" height="176" alt="image"
src="https://github.com/user-attachments/assets/45e95934-400a-4f0f-b46d-656011affea8"
/>




**semconv:**

<img width="900" height="650" alt="image"
src="https://github.com/user-attachments/assets/6b4fb7f3-f81b-4e24-afab-a1efb7581d4b"
/>

<img width="900" height="635" alt="image"
src="https://github.com/user-attachments/assets/1ed5d709-d129-4737-883f-4b4b0518b5c1"
/>

<img width="900" height="501" alt="image"
src="https://github.com/user-attachments/assets/83eac473-f8f3-4fd8-8244-f9abca55ee07"
/>

<img width="900" height="177" alt="image"
src="https://github.com/user-attachments/assets/6985b0c6-de80-41eb-8ee4-60cf0ca861f4"
/>



>[!NOTE]
>Disk Space Available metric value is not the same between otel and
semconv, and that is because of the difference in how the `filesystem`
scrapper collects the same data
Here is the data broken down by mount point to help understand what
happens

| otel | beats |
|------|-----|
|<img width="861" height="496" alt="image"
src="https://github.com/user-attachments/assets/62a7e073-e661-40fa-8a0b-45d70edce714"
/>|<img width="1178" height="520" alt="image"
src="https://github.com/user-attachments/assets/d968f3f3-0cde-41c1-8984-424fbfa69df5"
/>|




### How to test:

- Clone:
https://github.com/crespocarlos/elastic-stack-docker-compose/tree/inframetricsreceiver-removal-test-env
- Spin up the docker containers
- Connect your local kibana to the elasticsearch container
- Set the `xpack.infra.featureFlags.hostOtelEnabled: true`
- Navigate to Infrastructure > Hosts
delanni pushed a commit to delanni/kibana that referenced this pull request Aug 5, 2025
closes [elastic#226333](elastic#226333)

## Summary

This PR adds Otel system metrics Lens formulas and enables them on the
hosts view



**ecs:**

<img width="900" height="645" alt="image"
src="https://github.com/user-attachments/assets/e79ac886-f398-41d4-99a3-eaeeeb598596"
/>

<img width="900" height="615" alt="image"
src="https://github.com/user-attachments/assets/586a6793-d536-4f0e-8ed5-6a9cc801e1ca"
/>

<img width="900" height="501" alt="image"
src="https://github.com/user-attachments/assets/fc52ea34-62e2-4c31-89b2-e1e2185849c8"
/>

<img width="900" height="176" alt="image"
src="https://github.com/user-attachments/assets/45e95934-400a-4f0f-b46d-656011affea8"
/>




**semconv:**

<img width="900" height="650" alt="image"
src="https://github.com/user-attachments/assets/6b4fb7f3-f81b-4e24-afab-a1efb7581d4b"
/>

<img width="900" height="635" alt="image"
src="https://github.com/user-attachments/assets/1ed5d709-d129-4737-883f-4b4b0518b5c1"
/>

<img width="900" height="501" alt="image"
src="https://github.com/user-attachments/assets/83eac473-f8f3-4fd8-8244-f9abca55ee07"
/>

<img width="900" height="177" alt="image"
src="https://github.com/user-attachments/assets/6985b0c6-de80-41eb-8ee4-60cf0ca861f4"
/>



>[!NOTE]
>Disk Space Available metric value is not the same between otel and
semconv, and that is because of the difference in how the `filesystem`
scrapper collects the same data
Here is the data broken down by mount point to help understand what
happens

| otel | beats |
|------|-----|
|<img width="861" height="496" alt="image"
src="https://github.com/user-attachments/assets/62a7e073-e661-40fa-8a0b-45d70edce714"
/>|<img width="1178" height="520" alt="image"
src="https://github.com/user-attachments/assets/d968f3f3-0cde-41c1-8984-424fbfa69df5"
/>|




### How to test:

- Clone:
https://github.com/crespocarlos/elastic-stack-docker-compose/tree/inframetricsreceiver-removal-test-env
- Spin up the docker containers
- Connect your local kibana to the elasticsearch container
- Set the `xpack.infra.featureFlags.hostOtelEnabled: true`
- Navigate to Infrastructure > Hosts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Infra][Hosts UI] OTel system metrics - Lens

3 participants