Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Consuming multiple partitions #1568

Closed
sehz opened this issue Sep 3, 2021 · 0 comments
Closed

Feature: Consuming multiple partitions #1568

sehz opened this issue Sep 3, 2021 · 0 comments
Assignees
@morenol
Labels
consumer partition SPU SPU related UX/Usability
Milestone
0.9.9

Comments

@sehz
Copy link
Contributor

sehz commented Sep 3, 2021 •
edited
Loading

Currently Consumer are able to read from a single partition. We need ability to read from multiple partition concurrently.

By default, consume should retrieve records from all partitions in a topic. But it also should support:

  • list of partitions
  • partitions matched by some wildcard.

Records retrieve among multiple partitions are not ordered
@sehz sehz changed the title Feature: Multiple partition consumer Feature: Consuming multiple partitions Sep 3, 2021
@nacardin nacardin added this to the 0.9.8 milestone Sep 15, 2021
@nacardin nacardin modified the milestones: 0.9.8, 0.9.9 Sep 22, 2021
@morenol morenol mentioned this issue Sep 28, 2021
Closed
@sehz sehz mentioned this issue Sep 29, 2021
Closed
@bors bors bot closed this as completed in beb75db Sep 29, 2021
@tjtelan tjtelan mentioned this issue Sep 29, 2021
Closed
bors bot pushed a commit that referenced this issue Sep 30, 2021
@sehz
fix consuming with multiple segments (#1700)
87a756b 
resolves #1568

* Remove unneeded spawn handle in Stream Fetch Handler
* Fix Storage segment list search
* Fix segmentload loading
* Properly update end offset when active segment is rollover
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@morenol morenol

Labels
consumer partition SPU SPU related UX/Usability
Projects
None yet
Milestone
0.9.9
3 participants
@sehz @nacardin @morenol