Skip to content

DOC-5424 time series updates #1830

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jul 10, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
699 changes: 675 additions & 24 deletions content/develop/data-types/timeseries/_index.md

Large diffs are not rendered by default.

28 changes: 0 additions & 28 deletions content/develop/data-types/timeseries/clients.md

This file was deleted.

109 changes: 0 additions & 109 deletions content/develop/data-types/timeseries/development.md

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,12 @@ categories:
description: 'Out-of-order / backfilled ingestion performance considerations

'
linkTitle: Out-of-order / backfilled ingestion performance considerations
linkTitle: Out-of-order/backfill performance
aliases:
- /develop/data-types/timeseries/reference/out-of-order_performance_considerations
- /develop/data-types/timeseries/reference/out-of-order_performance_considerations/
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've just started seeing aliases like this, with both no trailing slash and with. Are both necessary?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dwdougherty TBH, I don't know, but my recent restructuring PR apparently had dodgy aliases (even though they looked right) and the PR to fix had both slash and no-slash aliases (and was reported to work OK). I don't know why it would make any difference, but I still find Hugo a bit enigmatic :-)

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You and me both. 🫥

- /develop/data-types/timeseries/reference/
- /develop/data-types/timeseries/reference
title: Out-of-order / backfilled ingestion performance considerations
weight: 5
---
Expand Down Expand Up @@ -46,11 +51,11 @@ The graphs and tables below make these key points:

- We've observed a maximum 95% drop in the achievable ops/sec even at 99% out-of-order ingestion. (Again, reducing the chunk size can cut the impact in half.)

<img src="images/compressed-overall-ops-sec-vs-out-of-order-percentage.png" alt="compressed-overall-ops-sec-vs-out-of-order-percentage"/>
{{< image filename="/images/timeseries/compressed-overall-ops-sec-vs-out-of-order-percentage.webp" alt="compressed-overall-ops-sec-vs-out-of-order-percentage" >}}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just because I'm curious... was there an edict to begin using WebP images rather than PNGs? The downside to WebP images is that they don't render in GitHub. In other PRs where graphics are swapped, you could see the change side by side in the PR diff viewer; can't do that with WebP. No axe to grind; just thought I'd ask.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dwdougherty It's just the file size (typically about half the size of the equivalent PNG, and no need to use pngcrush or other tools to optimise). "Speed is our superpower", etc, and we're guided to try to have the fastest everything (website, tools...) so I figured that gradually de-crufting and optimising what we've got in the docs was in order.


<img src="images/compressed-overall-p50-lat-vs-out-of-order-percentage.png" alt="compressed-overall-p50-lat-vs-out-of-order-percentage"/>
{{< image filename="/images/timeseries/compressed-overall-p50-lat-vs-out-of-order-percentage.webp" alt="compressed-overall-p50-lat-vs-out-of-order-percentage" >}}

<img src="images/compressed-out-of-order-overhead-table.png" alt="compressed-out-of-order-overhead-table"/>
{{< image filename="/images/timeseries/compressed-out-of-order-overhead-table.webp" alt="compressed-out-of-order-overhead-table" >}}

## Uncompressed chunks out-of-order/backfilled impact analysis

Expand All @@ -63,8 +68,8 @@ Apart from that, we can observe the following key take-aways:

- We've observed a maximum 45% drop in the achievable ops/sec, even at 99% out-of-order ingestion.

<img src="images/uncompressed-overall-ops-sec-vs-out-of-order-percentage.png" alt="uncompressed-overall-ops-sec-vs-out-of-order-percentage"/>
{{< image filename="/images/timeseries/uncompressed-overall-ops-sec-vs-out-of-order-percentage.webp" alt="uncompressed-overall-ops-sec-vs-out-of-order-percentage" >}}

<img src="images/uncompressed-overall-p50-lat-vs-out-of-order-percentage.png" alt="uncompressed-overall-p50-lat-vs-out-of-order-percentage"/>
{{< image filename="/images/timeseries/uncompressed-overall-p50-lat-vs-out-of-order-percentage.webp" alt="uncompressed-overall-p50-lat-vs-out-of-order-percentage" >}}

<img src="images/uncompressed-out-of-order-overhead-table.png" alt="uncompressed-out-of-order-overhead-table"/>
{{< image filename="/images/timeseries/uncompressed-out-of-order-overhead-table.webp" alt="uncompressed-out-of-order-overhead-table" >}}
Loading