Skip to content

Commit

Permalink
Refactor the PusherConsumer interactions (#9133)
Browse files Browse the repository at this point in the history
- Introduce a new `BatchingQueue` to reveal the intentions of a queue per shard.
- Removed the need to call `Close` as we pushed data into TSDB from the main loop. This was really confusing given we were using close as a semantic to "no more items are coming" and ensure any incomplete batches were done.
- Renamed and moved the `noopPusherCloser` which is more of an alternative way to push data without any sort of concurrency.
- Inlined a few methods to get rid of certain level of indirection that made the code harder to understand.
  • Loading branch information
gotjosh authored Sep 19, 2024
1 parent bbe4666 commit 16f8a12
Show file tree
Hide file tree
Showing 4 changed files with 458 additions and 160 deletions.
Loading

0 comments on commit 16f8a12

Please sign in to comment.