You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Manikumar (JIRA)" <ji...@apache.org> on 2017/10/29 09:29:02 UTC

[jira] [Resolved] (KAFKA-845) Re-implement shallow iteration on 0.8.1

     [ https://issues.apache.org/jira/browse/KAFKA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Manikumar resolved KAFKA-845.
-----------------------------
    Resolution: Auto Closed

Closing inactive issue. 


> Re-implement shallow iteration on 0.8.1
> ---------------------------------------
>
>                 Key: KAFKA-845
>                 URL: https://issues.apache.org/jira/browse/KAFKA-845
>             Project: Kafka
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 0.8.1
>            Reporter: Maxime Brugidou
>
> After KAFKA-732 we decided to not support the shallow iteration feature to speed up the 0.8 release.
> This severely impacts the performance for heavy mirroring between clusters. The MirrorMaker needs to decompress/recompress the data which actually triple the CPU compression cost in the data flow (initial compression + 2x compression for mirroring).
> It would be great to discuss a solution to re-implement the feature correctly.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)