Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

consumer failed on broker version fall back #3283

Closed
6 of 7 tasks
write2jaydeep opened this issue Mar 3, 2021 · 1 comment
Closed
6 of 7 tasks

consumer failed on broker version fall back #3283

write2jaydeep opened this issue Mar 3, 2021 · 1 comment

Comments

@write2jaydeep
Copy link

write2jaydeep commented Mar 3, 2021 •
edited
Loading

Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ

Description

Hi @edenhill
We are using consumer with rd_kafka_consume_queue() API and we trying to consumer messages from broker
It is working fine with Broker "kafka_2.12-2.5.0" but it failed with "0.10.1"

I have attached logs here with protocol,topic debug level

Please help me what's wrong?
Thank you very much! I appreciate your help!

logs

G 175200 -0-KAFKA-INT: 1614793920.858 ARI-RDKAFKA-7-INIT: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: librdkafka v1.5.0 (0x10500ff) rdkafka#consumer-1 initialized (builtin.features gz
ip,snappy,ssl,sasl,regex,lz4,sasl_gssapi,sasl_plain,sasl_scram,plugins,sasl_oauthbearer, GCC GXX INS
TALL GNULD LIBDL PLUGINS ZLIB SSL SASL_CYRUS HDRHISTOGRAM SYSLOG SNAPPY SOCKEM SASL_SCRAM SASL_OAUTH
BEARER, debug 0x84)
G 175200 -0-CMR-LOG: % Subscribing to esb-talech-asset-inbound topics

G 175200 -0-KAFKA-INT: 1614793920.887 ARI-RDKAFKA-7-CONNECTED: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-D
NS.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Connected (#
1)
G 175200 -0-KAFKA-INT: 1614793920.887 ARI-RDKAFKA-7-FEATURE: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS
.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Updated enable
d protocol features +ApiVersion to ApiVersion
G 175200 -0-KAFKA-INT: 1614793920.887 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Sent ApiVersionRe
quest (v3, 40 bytes @ 0, CorrId 1)
G 175200 -0-KAFKA-INT: 1614793920.918 ARI-RDKAFKA-7-RECV: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Received ApiVersi
onResponse (v3, 6 bytes, CorrId 1, rtt 31.41ms)
G 175200 -0-KAFKA-INT: 1614793920.918 ARI-RDKAFKA-7-PROTOERR: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DN
S.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Protocol pars
e failure for ApiVersion v3 at 3/6 (rd_kafka_handle_ApiVersion:1945) (incorrect broker.version.fallb
ack?)
G 175200 -0-KAFKA-INT: 1614793920.918 ARI-RDKAFKA-7-PROTOERR: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DN
S.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: ApiArrayCnt -
1 out of range
G 175200 -0-KAFKA-INT: 1614793920.918 ARI-RDKAFKA-7-APIVERSION: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-
DNS.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: ApiVersionR
equest v3 failed due to UNSUPPORTED_VERSION: retrying with v0
G 175200 -0-KAFKA-INT: 1614793920.918 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Sent ApiVersionRe
quest (v0, 21 bytes @ 0, CorrId 2)
G 175200 -0-KAFKA-INT: 1614793920.945 ARI-RDKAFKA-7-RECV: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Received ApiVersi
onResponse (v0, 132 bytes, CorrId 2, rtt 27.01ms)
G 175200 -0-KAFKA-INT: 1614793920.945 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Sent SaslHandshak
eRequest (v0, 29 bytes @ 0, CorrId 3)
G 175200 -0-KAFKA-INT: 1614793920.969 ARI-RDKAFKA-7-RECV: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Received SaslHand
shakeResponse (v0, 14 bytes, CorrId 3, rtt 23.88ms)
G 175200 -0-KAFKA-INT: 1614793920.969 ARI-RDKAFKA-7-SASLMECHS: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-D
NS.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Broker suppo
rted SASL mechanisms: GSSAPI
G 175200 -0-KAFKA-INT: 1614793920.971 ARI-RDKAFKA-5-LIBSASL: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS
.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: GSSAPI client
step 1
G 175201 -0-KAFKA-INT: 1614793921.199 ARI-RDKAFKA-5-LIBSASL: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS
.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: GSSAPI client
step 1
G 175201 -0-KAFKA-INT: 1614793921.231 ARI-RDKAFKA-5-LIBSASL: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS
.COM:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: GSSAPI client
step 2
G 175201 -0-KAFKA-INT: 1614793921.241 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Sent MetadataRequ
est (v2, 25 bytes @ 0, CorrId 4)
G 175201 -0-KAFKA-INT: 1614793921.265 ARI-RDKAFKA-7-RECV: rdkafka#consumer-1: [thrd:sasl_plaintext://website.US.BANK-DNS.CO
M:6668/bootstrap]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Received Metadata
Response (v2, 201 bytes, CorrId 4, rtt 24.21ms)
G 175201 -0-KAFKA-INT: 1614793921.271 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dns.co
m:6668/1002]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Sent FindCoordinatorRe
quest (v0, 30 bytes @ 0, CorrId 5)
G 175201 -0-KAFKA-INT: 1614793921.296 ARI-RDKAFKA-7-RECV: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dns.co
m:6668/1002]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Received FindCoordinat
orResponse (v0, 42 bytes, CorrId 5, rtt 25.18ms)
G 175201 -0-KAFKA-INT: 1614793921.299 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dns.co
m:6668/1002]: sasl_plaintext://VMIKSA69901C7D.US.BANK-DNS.COM:6668/bootstrap: Sent FindCoordinatorRe
quest (v0, 30 bytes @ 0, CorrId 6)
G 175201 -0-KAFKA-INT: 1614793921.323 ARI-RDKAFKA-7-CONNECTED: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-d
ns.com:6668/1002]: GroupCoordinator/1001: Connected (#1)
G 175201 -0-KAFKA-INT: 1614793921.323 ARI-RDKAFKA-7-FEATURE: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dns
.com:6668/1002]: GroupCoordinator/1001: Updated enabled protocol features +ApiVersion to ApiVersion
G 175201 -0-KAFKA-INT: 1614793921.323 ARI-RDKAFKA-7-SEND: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dns.co
m:6668/1002]: GroupCoordinator/1001: Sent ApiVersionRequest (v3, 40 bytes @ 0, CorrId 1)
G 175201 -0-KAFKA-INT: 1614793921.467 ARI-RDKAFKA-7-RECV: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dns.co
m:6668/1002]: GroupCoordinator/1001: Received ApiVersionResponse (v3, 6 bytes, CorrId 1, rtt 144.19m
s)
G 175201 -0-KAFKA-INT: 1614793921.467 ARI-RDKAFKA-7-PROTOERR: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dn
s.com:6668/1002]: GroupCoordinator/1001: Protocol parse failure for ApiVersion v3 at 3/6 (rd_kafka_h
andle_ApiVersion:1945) (incorrect broker.version.fallback?)
G 175201 -0-KAFKA-INT: 1614793921.467 ARI-RDKAFKA-7-PROTOERR: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-dn
s.com:6668/1002]: GroupCoordinator/1001: ApiArrayCnt -1 out of range
G 175201 -0-KAFKA-INT: 1614793921.467 ARI-RDKAFKA-7-APIVERSION: rdkafka#consumer-1: [thrd:sasl_plaintext://website.us.bank-
dns.com:6668/1002]: GroupCoordinator/1001: ApiVersionRequest v3 failed due to UNSUPPORTED_VERSION: r
etrying with v0

Checklist

IMPORTANT: We will close issues where the checklist has not been completed.

Please provide the following information:

  • librdkafka version (release number or git tag): 1.5.0
  • Apache Kafka version: 0.10.1
  • librdkafka client configuration: broker.version.fallback=0.10.2.0,
  • Operating system: Ubuntu Linux
  • Provide logs (with debug=.. as necessary) from librdkafka
  • Provide broker log excerpts
  • Critical issue
@edenhill
Copy link
Contributor

edenhill commented Mar 8, 2021

What's the actual error or behaviour you're seeing on 0.10.2.0?
Set debug=cgrp,broker to get more insight into the consumer group handling.

note: you don't need to set broker.version.fallback for any version >= 0.10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@edenhill @write2jaydeep