Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dataset quality] Remove DataStreams stats API usage on serverless #192166

Closed
yngrdyn opened this issue Sep 5, 2024 · 1 comment · Fixed by #192839
Closed

[Dataset quality] Remove DataStreams stats API usage on serverless #192166

yngrdyn opened this issue Sep 5, 2024 · 1 comment · Fixed by #192839
Assignees
Labels
Team:obs-ux-logs Observability Logs User Experience Team

Comments

@yngrdyn
Copy link
Contributor

yngrdyn commented Sep 5, 2024

With the introduction of DataStreams API verbose mode and dataStreamStats API being marked as internal we need to remove the usages of the latter.

Right now we make use of this API to retrieve maximum_timestamp which is now included in the verbose mode of dataStreams API.

💡 Implementation hints

  • Remove usage of API in serverless.
  • I'd use the verbose mode to get maximum_timestamp for both flavours so we keep the code as agnostic-deployment as we can, and leave the stats to only query sizes in stateful (which is unavoidable different in serverless)
@yngrdyn yngrdyn added the Team:obs-ux-logs Observability Logs User Experience Team label Sep 5, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

@yngrdyn yngrdyn changed the title [Dataset quality] Remove DataStreams API usage on serverless [Dataset quality] Remove DataStreams stats API usage on serverless Sep 6, 2024
@yngrdyn yngrdyn self-assigned this Sep 17, 2024
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Sep 19, 2024
…lastic#192839)

Closes elastic#192166.

This PR aims to remove the usage of `DataStreamStats` API in serverless.
Aditionally we now make use of the new verbose mode for `DataStream` API
which allow us to still show the `lastActivity` for serverless projects.
The change was implemented for both flavours.

Visually it won't represent any changes at the moment, but here are the
two flavours still working as before

https://github.com/user-attachments/assets/18cc9b14-24f1-438a-ac07-565c3e728991
(cherry picked from commit 444f95e)
kibanamachine referenced this issue Sep 20, 2024
…less (#192839) (#193468)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Dataset quality] remove usage of dataStreamStats API in serverless
(#192839)](#192839)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Yngrid
Coello","email":"yngrid.coello@elastic.co"},"sourceCommit":{"committedDate":"2024-09-19T18:47:45Z","message":"[Dataset
quality] remove usage of dataStreamStats API in serverless
(#192839)\n\nCloses
https://github.com/elastic/kibana/issues/192166.\n\nThis PR aims to
remove the usage of `DataStreamStats` API in serverless.\nAditionally we
now make use of the new verbose mode for `DataStream` API\nwhich allow
us to still show the `lastActivity` for serverless projects.\nThe change
was implemented for both flavours.\n\nVisually it won't represent any
changes at the moment, but here are the\ntwo flavours still working as
before\n\n\nhttps://github.com/user-attachments/assets/18cc9b14-24f1-438a-ac07-565c3e728991","sha":"444f95ed0b4a2d251851f40d62b126544a6c17c0","branchLabelMapping":{"^v9.0.0$":"main","^v8.16.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability"],"title":"[Dataset
quality] remove usage of dataStreamStats API in
serverless","number":192839,"url":"https://github.com/elastic/kibana/pull/192839","mergeCommit":{"message":"[Dataset
quality] remove usage of dataStreamStats API in serverless
(#192839)\n\nCloses
https://github.com/elastic/kibana/issues/192166.\n\nThis PR aims to
remove the usage of `DataStreamStats` API in serverless.\nAditionally we
now make use of the new verbose mode for `DataStream` API\nwhich allow
us to still show the `lastActivity` for serverless projects.\nThe change
was implemented for both flavours.\n\nVisually it won't represent any
changes at the moment, but here are the\ntwo flavours still working as
before\n\n\nhttps://github.com/user-attachments/assets/18cc9b14-24f1-438a-ac07-565c3e728991","sha":"444f95ed0b4a2d251851f40d62b126544a6c17c0"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/192839","number":192839,"mergeCommit":{"message":"[Dataset
quality] remove usage of dataStreamStats API in serverless
(#192839)\n\nCloses
https://github.com/elastic/kibana/issues/192166.\n\nThis PR aims to
remove the usage of `DataStreamStats` API in serverless.\nAditionally we
now make use of the new verbose mode for `DataStream` API\nwhich allow
us to still show the `lastActivity` for serverless projects.\nThe change
was implemented for both flavours.\n\nVisually it won't represent any
changes at the moment, but here are the\ntwo flavours still working as
before\n\n\nhttps://github.com/user-attachments/assets/18cc9b14-24f1-438a-ac07-565c3e728991","sha":"444f95ed0b4a2d251851f40d62b126544a6c17c0"}}]}]
BACKPORT-->

Co-authored-by: Yngrid Coello <yngrid.coello@elastic.co>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:obs-ux-logs Observability Logs User Experience Team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants