You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "A. Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2021/05/03 17:10:00 UTC

[jira] [Created] (KAFKA-12746) Allow StreamThreads to recover from some exceptions without killing/replacing the thread

A. Sophie Blee-Goldman created KAFKA-12746:
----------------------------------------------

             Summary: Allow StreamThreads to recover from some exceptions without killing/replacing the thread
                 Key: KAFKA-12746
                 URL: https://issues.apache.org/jira/browse/KAFKA-12746
             Project: Kafka
          Issue Type: Sub-task
          Components: streams
            Reporter: A. Sophie Blee-Goldman


As the title says, in some cases it should be possible to recover the StreamThread without killing and restarting it (it may in fact be _possible_ for all exception types, though in some cases it may be preferable to just let the thread die and start up with a fresh thread). 

This would obviously allow for greatly mitigating the impact of errors in the subtopology, and allow us to retry with little overhead. It may also make it easier to improve the processing semantics in the face of exceptions.

This will also be useful if/when we implement a more sophisticated task scheduling which can, for example, work to deprioritize tasks that are frequently experiencing errors without crashing the whole thread or dropping the task entirely



--
This message was sent by Atlassian Jira
(v8.3.4#803005)