You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2018/11/19 01:09:00 UTC

[jira] [Commented] (KAFKA-7566) Add sidecar job to leader (or a random single follower) only

    [ https://issues.apache.org/jira/browse/KAFKA-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691145#comment-16691145 ] 

Guozhang Wang commented on KAFKA-7566:
--------------------------------------

[~bchen225242] could you elaborate a bit more on your use case here? I'm not sure I fully follow on {{we also don't want to schedule it as a regular stream task so that we will be blocking normal streaming operation. }}. 

> Add sidecar job to leader (or a random single follower) only
> ------------------------------------------------------------
>
>                 Key: KAFKA-7566
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7566
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Boyang Chen
>            Priority: Minor
>
> Hey there,
> recently we need to add an archive job to a streaming application. The caveat is that we need to make sure only one instance is doing this task to avoid potential race condition, and we also don't want to schedule it as a regular stream task so that we will be blocking normal streaming operation. 
> Although we could do so by doing a zk lease, I'm raising the case here since this could be some potential use case for streaming job also. For example, there are some `leader specific` operation we could schedule in DSL instead of adhoc manner.
> Let me know if you think this makes sense to you, thank you!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)