Skip to content

kafka.common.OffsetOutOfRangeError: FetchResponse(topic='earthshaker_nginx_access', partition=0, error=1, highwaterMark=-1, messages=<generator object _decode_message_set_iter at 0x7fb7cb243c30>) #275

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wangxiangyu opened this issue Dec 12, 2014 · 1 comment

Comments

@wangxiangyu
Copy link

hi
I used SimpleConsumer to consume log and I set auto_commit=False. After a period of time, I init a new consumer, the new consumer uses the init offsets: {0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0}. But I think the 0 offset data has been deleted caused by the rotation in kafka. So this error "kafka.common.OffsetOutOfRangeError: FetchResponse(topic='earthshaker_nginx_access', partition=0, error=1, highwaterMark=-1, messages=<generator object _decode_message_set_iter at 0x7fb7cb243c30>)" happened.
(1) how can I get the correct offset?
(2)I do not want to use the group characher of SimpleConsumer, I want each consumer to consume log separately. So I set auto_commit to false ,use the same group name and each consumer record its own offset. Any other ideas?
Thank you!~

@dpkp
Copy link
Owner

dpkp commented Dec 12, 2014

dup of #263 -- please see discussion there!

@dpkp dpkp closed this as completed Dec 12, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants