You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Jay Kreps (JIRA)" <ji...@apache.org> on 2013/09/17 18:37:53 UTC

[jira] [Commented] (KAFKA-1056) Evenly Distribute Intervals in OffsetIndex

    [ https://issues.apache.org/jira/browse/KAFKA-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769664#comment-13769664 ] 

Jay Kreps commented on KAFKA-1056:
----------------------------------

Agreed. This becomes a problem in the case where producer batch size >> index interval. This basically just requires properly calculating a set of offset index entries to append. This is a bit tricky but doable, I think.
                
> Evenly Distribute Intervals in OffsetIndex
> ------------------------------------------
>
>                 Key: KAFKA-1056
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1056
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Guozhang Wang
>            Assignee: Guozhang Wang
>             Fix For: 0.8.1
>
>
> Today a new entry will be created in OffsetIndex for each produce request regardless of the number of messages it contains. It is better to evenly distribute the intervals between index entries for index search efficiency.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira