-
Notifications
You must be signed in to change notification settings - Fork 894
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Consumer.poll
goes into infinite loop
#1767
Comments
It feels that the host is not reachable or up. |
@pranavrth the host gets up back in like max 2 mins, it's just k8s scheduling it on the another node which changes the IP, the service container works fine when it's restarted. |
@pranavrth, any luck, please? Appears that the package is handling this issue at the very low level and not raising an exception? |
@pranavrth, upon further digging in the source code, we found that we can use |
Can you enable debug logging by using |
Description
Consumer.poll
client is going into infinite loop when the Kafka is running on Kubernetes. When the cluster is scheduled on the new node is just stuck on the below error:As you can see in the screenshot the service was just stuck and then it recovered after like 12 hours.
How to reproduce
Run the above code and then restart the kafka cluster or change the node in k8s
Checklist
Please provide the following information:
confluent_kafka.version()
andconfluent_kafka.libversion()
):2.1.1
{ "bootstrap.servers": "", "client.id": socket.gethostname(), "auto.offset.reset": "earliest", "enable.auto.commit": False, "group.id": "", }
'debug': '..'
as necessary)The text was updated successfully, but these errors were encountered: