You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org> on 2016/02/10 07:53:18 UTC

[jira] [Commented] (SAMZA-864) allow job not to fail in case of incorrect number of partitions on checkpoint topic

    [ https://issues.apache.org/jira/browse/SAMZA-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140416#comment-15140416 ] 

Yi Pan (Data Infrastructure) commented on SAMZA-864:
----------------------------------------------------

+1 on the patch. Thanks!

> allow job not to fail in case of incorrect number of partitions on checkpoint topic
> -----------------------------------------------------------------------------------
>
>                 Key: SAMZA-864
>                 URL: https://issues.apache.org/jira/browse/SAMZA-864
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Boris Shkolnik
>            Assignee: Boris Shkolnik
>         Attachments: rb43053.patch
>
>
> Today, if there is an incorrect number of partitions on the job's checkpoint topic, the job will fail right away. The topic should have 1 partition.
> Unfortunately, there is no easy solution for this problem, since the number of partitions on the topic cannot be decreased (or topic cannot be deleted).
> We should add a config that will allow just to issue a warning in this case and keep going. We also need to make sure the checkpoints are written to partition 0 only.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)