Skip to content

Commit

Permalink
Refactor the PusherConsumer interactions
Browse files Browse the repository at this point in the history
- Introduce a new `BatchingQueue` to reveal the intentions of a queue per shard.
- Removed the need to call `Close` as we pushed data into TSDB from the main loop. This was really confusing given we were using close as a semantic to "no more items are coming" and ensure any incomplete batches were done.
- Renamed and moved the `noopPusherCloser` which is more of an alternative way to push data without any sort of concurrency.
- Inlined a few methods to get rid of certain level of indirection that made the code harder to understand.
  • Loading branch information
gotjosh committed Sep 19, 2024
1 parent 0d4a616 commit 08a724a
Show file tree
Hide file tree
Showing 4 changed files with 461 additions and 161 deletions.
Loading

0 comments on commit 08a724a

Please sign in to comment.