Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consumer hangs when trying to consume old offsets on a 0.10 broker #29

Closed
lucianjon opened this issue Aug 22, 2016 · 1 comment
Closed

Comments

@lucianjon
Copy link

When trying to consume from a topic using offsets older than a certain point the consumer will hang until you kill it. It appears to work fine using offsetsNewest or an absolute value above some point. When trying to consume a topic with 155 log entries and starting with an offset anywhere under roughly 30 would hang. Anything above that would work as normal.

This appears to only affect consuming against 0.10 clusters.

@lucianjon lucianjon changed the title Consumer hangs when trying to consume old offsets on 0.10 cluster Consumer hangs when trying to consume old offsets on a 0.10 broker Aug 22, 2016
@fgeller
Copy link
Owner

fgeller commented Aug 27, 2016

i tried this against a kafka 10 broker (after upgrading sarama):

$ ./kt consume -brokers fg.lan -topic x -offsets all=150:155
{"partition":0,"offset":150,"key":null,"value":"hello"}
{"partition":0,"offset":151,"key":null,"value":"hello"}
{"partition":0,"offset":152,"key":null,"value":"hello"}
{"partition":0,"offset":153,"key":null,"value":"hello"}
{"partition":0,"offset":154,"key":null,"value":"hello"}
{"partition":0,"offset":155,"key":null,"value":"hello"}
$

is that what caused issues before?
the kt version above defaults to protocol v0.10.0.0 but you can specify it as well. e.g. to use v0.9.0.1:

$ ./kt consume -brokers fg.lan -topic x -version v0.9.0.1 -offsets all=150:155

could you upgrade kt and re-open if issue remains?

go get -u github.com/fgeller/kt

or via the releases.

@fgeller fgeller closed this as completed Aug 27, 2016
dangogh pushed a commit to dangogh/hkt that referenced this issue May 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants