You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2016/03/09 14:34:40 UTC
[jira] [Created] (FLINK-3595) Kafka09 consumer thread does not
interrupt when stuck in record emission
Stephan Ewen created FLINK-3595:
-----------------------------------
Summary: Kafka09 consumer thread does not interrupt when stuck in record emission
Key: FLINK-3595
URL: https://issues.apache.org/jira/browse/FLINK-3595
Project: Flink
Issue Type: Bug
Components: Kafka Connector
Affects Versions: 1.0.0
Reporter: Stephan Ewen
Assignee: Stephan Ewen
Priority: Critical
Fix For: 1.1.0, 1.0.1
When canceling a job, the Kafka 0.9 Consumer Thread may be stuck in a blocking method (output emitting) and never wakes up.
The thread as a whole cannot be simply interrupted, because of a bug in Kafka that makes the consumer freeze/hang up on interrupt.
There are two possible solutions:
- allow and call interrupt when the consumer thread is emitting elements
- destroy the output network buffer pools eagerly on canceling. The Kafka thread will then throw an exception if it is stuck in emitting elements and it will terminate, which is accepted in case the status is canceled.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)