You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2021/01/08 19:12:00 UTC
[jira] [Created] (GOBBLIN-1355) Make task interruption optional on
Gobblin task cancellation
Sudarshan Vasudevan created GOBBLIN-1355:
--------------------------------------------
Summary: Make task interruption optional on Gobblin task cancellation
Key: GOBBLIN-1355
URL: https://issues.apache.org/jira/browse/GOBBLIN-1355
Project: Apache Gobblin
Issue Type: Improvement
Components: gobblin-core
Affects Versions: 0.16.0
Reporter: Sudarshan Vasudevan
Assignee: Abhishek Tiwari
Fix For: 0.16.0
Currently, the thread running a Gobblin task is interrupted when a task cancellation is invoked. When such a task is managing a Kafka consumer for instance, the interrupt leaves the consumer instance in a corrupt state, particularly if the consumer is in the middle of a poll() when the interrupt occurs. This in turn prevents the subsequent clean up of the consumer instance resulting in a potential resource leak.
With this change, we provide the option to avoid interrupting the thread in aforementioned scenarios and let the poll() return before the thread is shutdown.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)