You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Umesh Chaudhary (JIRA)" <ji...@apache.org> on 2017/05/27 08:55:04 UTC

[jira] [Commented] (KAFKA-5093) Load only batch header when rebuilding producer ID map

    [ https://issues.apache.org/jira/browse/KAFKA-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027362#comment-16027362 ] 

Umesh Chaudhary commented on KAFKA-5093:
----------------------------------------

Tried to co-relate it with KIP but was unable to locate the intended piece of code to tweak. If possible, can you please point that? 

> Load only batch header when rebuilding producer ID map
> ------------------------------------------------------
>
>                 Key: KAFKA-5093
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5093
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Jason Gustafson
>            Priority: Blocker
>              Labels: exactly-once
>             Fix For: 0.11.0.0
>
>
> When rebuilding the producer ID map for KIP-98, we unnecessarily load the full record data into memory when scanning through the log. It would be better to only load the batch header since it is all that is needed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)