You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Boyang Chen (JIRA)" <ji...@apache.org> on 2018/10/29 19:23:03 UTC

[jira] [Created] (KAFKA-7566) Add sidecar job to leader (or a random single follower) only

Boyang Chen created KAFKA-7566:
----------------------------------

             Summary: Add sidecar job to leader (or a random single follower) only
                 Key: KAFKA-7566
                 URL: https://issues.apache.org/jira/browse/KAFKA-7566
             Project: Kafka
          Issue Type: Improvement
            Reporter: Boyang Chen


Hey there,

recently we need to add an archive job to a streaming application. The caveat is that we need to make sure only one instance is doing this task to avoid potential race condition, and we also don't want to schedule it as a regular stream task so that we will be blocking normal streaming operation. 

Although we could do so by doing a zk lease, I'm raising the case here since this could be some potential use case for streaming job also. For example, there are some `leader specific` operation we could schedule in DSL instead of adhoc manner.

Let me know if you think this makes sense to you, thank you!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)