You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Walker Carlson (Jira)" <ji...@apache.org> on 2022/02/18 16:09:00 UTC
[jira] [Created] (KAFKA-13676) When processing in ALOS we might as well commit progress made other tasks on a task specific exception
Walker Carlson created KAFKA-13676:
--------------------------------------
Summary: When processing in ALOS we might as well commit progress made other tasks on a task specific exception
Key: KAFKA-13676
URL: https://issues.apache.org/jira/browse/KAFKA-13676
Project: Kafka
Issue Type: Improvement
Components: streams
Reporter: Walker Carlson
Assignee: Walker Carlson
When processing in ALOS we might as well commit progress made other tasks on a task specific exception. If one task has an issue and we have already successfully completed processing on at least one task it would be good to commit those successfully processed tasks. This should prevent limit the duplicated records downstream and also be more efficient.
Also if one task is having lots of issues the other tasks can at least make progress. When we introduced the thread replacement mechanism this optimization became possible.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)