You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
hi
I used SimpleConsumer to consume log and I set auto_commit=False. After a period of time, I init a new consumer, the new consumer uses the init offsets: {0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0}. But I think the 0 offset data has been deleted caused by the rotation in kafka. So this error "kafka.common.OffsetOutOfRangeError: FetchResponse(topic='earthshaker_nginx_access', partition=0, error=1, highwaterMark=-1, messages=<generator object _decode_message_set_iter at 0x7fb7cb243c30>)" happened.
(1) how can I get the correct offset?
(2)I do not want to use the group characher of SimpleConsumer, I want each consumer to consume log separately. So I set auto_commit to false ,use the same group name and each consumer record its own offset. Any other ideas?
Thank you!~
The text was updated successfully, but these errors were encountered:
hi
I used SimpleConsumer to consume log and I set auto_commit=False. After a period of time, I init a new consumer, the new consumer uses the init offsets: {0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0}. But I think the 0 offset data has been deleted caused by the rotation in kafka. So this error "kafka.common.OffsetOutOfRangeError: FetchResponse(topic='earthshaker_nginx_access', partition=0, error=1, highwaterMark=-1, messages=<generator object _decode_message_set_iter at 0x7fb7cb243c30>)" happened.
(1) how can I get the correct offset?
(2)I do not want to use the group characher of SimpleConsumer, I want each consumer to consume log separately. So I set auto_commit to false ,use the same group name and each consumer record its own offset. Any other ideas?
Thank you!~
The text was updated successfully, but these errors were encountered: