You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "A. Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2021/05/03 17:10:00 UTC
[jira] [Created] (KAFKA-12746) Allow StreamThreads to recover from
some exceptions without killing/replacing the thread
A. Sophie Blee-Goldman created KAFKA-12746:
----------------------------------------------
Summary: Allow StreamThreads to recover from some exceptions without killing/replacing the thread
Key: KAFKA-12746
URL: https://issues.apache.org/jira/browse/KAFKA-12746
Project: Kafka
Issue Type: Sub-task
Components: streams
Reporter: A. Sophie Blee-Goldman
As the title says, in some cases it should be possible to recover the StreamThread without killing and restarting it (it may in fact be _possible_ for all exception types, though in some cases it may be preferable to just let the thread die and start up with a fresh thread).
This would obviously allow for greatly mitigating the impact of errors in the subtopology, and allow us to retry with little overhead. It may also make it easier to improve the processing semantics in the face of exceptions.
This will also be useful if/when we implement a more sophisticated task scheduling which can, for example, work to deprioritize tasks that are frequently experiencing errors without crashing the whole thread or dropping the task entirely
--
This message was sent by Atlassian Jira
(v8.3.4#803005)