Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consumer Offset not commited when using assign() to consume select partitions only #714

Closed
zoltan-fedor opened this issue May 31, 2016 · 2 comments

Comments

@zoltan-fedor
Copy link

When consuming from select partitions only, the offset is not being committed, but stays unchanged.

        kafka_consumer = KafkaConsumer(
            group_id=settings['kafka_group_id'],
            bootstrap_servers=settings['kafka_servers']
        )

        kafka_consumer.assign([
                TopicPartition(settings['topic'],2),
                TopicPartition(settings['topic'],4),
             ])

Checking the consumer offset of partition 2 and 4 shows now change, even after consuming 25M records.

@zoltan-fedor zoltan-fedor changed the title Offset not commited when using assign() to consume select partitions only Consumer Offset not commited when using assign() to consume select partitions only May 31, 2016
@dpkp
Copy link
Owner

dpkp commented May 31, 2016

I believe this is a dup of #626

@zoltan-fedor
Copy link
Author

Thanks, that helps, so at least I can work around it by using autocommit False

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants