You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/10/18 22:32:00 UTC

[jira] [Commented] (SAMZA-1465) Performance regression for KafkaCheckpointManager

    [ https://issues.apache.org/jira/browse/SAMZA-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210205#comment-16210205 ] 

ASF GitHub Bot commented on SAMZA-1465:
---------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/samza/pull/331


> Performance regression for KafkaCheckpointManager
> -------------------------------------------------
>
>                 Key: SAMZA-1465
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1465
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Jake Maes
>            Assignee: Jake Maes
>             Fix For: 0.14.0
>
>
> SAMZA-1427 introduced a performance regression with KafkaCheckpointManager. 
> We invoke the checkpoint manager once for each task and the old code would only read the delta for each subsequent call. The SAMZA-1427 code would reread the entire checkpoint topic for each call. 
> This effect is even worse when log compaction is not running on the broker. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)