Skip to content

Strange behaviour on Kafka multi consumers #470

Closed
@Gnucki

Description

@Gnucki

Hi,

I'm a bit confused with the use of rdkafka.
I start 2 consumers and a producer with following config:

enqueue:
    async_events:
        enabled: false
    transport:
        default: rdkafka
        rdkafka:
            global:
                group.id: '%app.name%'
                offset.store.method: broker
                metadata.broker.list: '%env(KAFKA_BROKER_LIST)%'
            topic:
                offset.store.method: broker
    client: ~

I publish a message on a topic with only 1 partition.
I expect only 1 consumer to process the message.
However, both process all messages.
Moreover, when I start a new consumer, it does not care of current commited offset and process all messages in the stream again.

Did I miss something?

Thanks for your help.

Note that I use Symfony 4.1 messenger (so php-enqueue/messenger-adapter).

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions