You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Walker Carlson (Jira)" <ji...@apache.org> on 2022/02/18 16:09:00 UTC

[jira] [Created] (KAFKA-13676) When processing in ALOS we might as well commit progress made other tasks on a task specific exception

Walker Carlson created KAFKA-13676:
--------------------------------------

             Summary: When processing in ALOS we might as well commit progress made other tasks on a task specific exception
                 Key: KAFKA-13676
                 URL: https://issues.apache.org/jira/browse/KAFKA-13676
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Walker Carlson
            Assignee: Walker Carlson


When processing in ALOS we might as well commit progress made other tasks on a task specific exception. If one task has an issue and we have already successfully completed processing on at least one task it would be good to commit those successfully processed tasks. This should prevent limit the duplicated records downstream and also be more efficient.

Also if one task is having lots of issues the other tasks can at least make progress. When we introduced the thread replacement mechanism this optimization became possible. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)