-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Recurrent "Error for partition" error in Server.log #1575
Comments
abhit011
changed the title
Recurrent Error for partition error
Recurrent "Error for partition" error in Server.log
Dec 2, 2017
@edenhill any pointers ? |
9 tasks
That looks like a broker issue, not a client one. |
But under what circumstances it can occur ? |
I'm sorry but this is for librdkafka issues and questions only. |
NW or what ? And it never gets recovered till i have to stop and start the brokers again |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
I am using librdkafka 0.9.2, fairly old and apache kafka 0.10.2.0 , did not update the librdkafka from 0.9.2 because it had been running satisfactory,in my stack.
Kafka Setup:
Setup: 3 ZK instances running on 3 different Windows Servers, 7 kafka Broker nodes running on single windows machine with different disk for logs directory....
It has two Kafka Topics with partition size 50 , and replication factor of 3.
My partition logic selection: like for each message (its unique ID % 50) , and then calling Kafka producer API to route a specific message to a particular topic partition .
But of-late there has been a unique case that's cropping out in Kafka broker nodes, its been running fine then one day one of my broker nodes started failing and on server.log , i have insane recursive such log statements
And the entire server.log has these logs
At the same time the controller.log
My traffic on Kafka has just increased by few hundred, and I feel that won't put any strange stuffs to kafka... Please help me in understanding why and under what circumstances the above error is occuring.
The above error occurred once in 6 months I ignored it at that time. .But of late this is the 3rd case in last 20 days....
How to reproduce
IMPORTANT: Always try to reproduce the issue on the latest released version (see https://github.com/edenhill/librdkafka/releases), if it can't be reproduced on the latest version the issue has been fixed.
Checklist
IMPORTANT: We will close issues where the checklist has not been completed.
Please provide the following information:
e.g., v0.10.5
e.g., 0.10.2.3
"socket.blocking.max.ms", "10"
"queue.buffering.max.ms", "10"
"produce.offset.report", "true"
"request.required.acks", "all" ] librdkafka client configuration:
e.g., message.timeout.ms=123, auto.reset.offset=earliest, ..
e.g., Centos 5 (x64)
debug=..
as necessary) from librdkafkaThe text was updated successfully, but these errors were encountered: