You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Manikumar Reddy (JIRA)" <ji...@apache.org> on 2015/06/12 18:06:01 UTC
[jira] [Commented] (KAFKA-2213) Log cleaner should write compacted
messages using configured compression type
[ https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583617#comment-14583617 ]
Manikumar Reddy commented on KAFKA-2213:
----------------------------------------
[~jjkoshy] pinging for review
> Log cleaner should write compacted messages using configured compression type
> -----------------------------------------------------------------------------
>
> Key: KAFKA-2213
> URL: https://issues.apache.org/jira/browse/KAFKA-2213
> Project: Kafka
> Issue Type: Bug
> Reporter: Joel Koshy
> Assignee: Manikumar Reddy
> Attachments: KAFKA-2213.patch, KAFKA-2213_2015-05-30_00:23:01.patch
>
>
> In KAFKA-1374 the log cleaner was improved to handle compressed messages. There were a couple of follow-ups from that:
> * We write compacted messages using the original compression type in the compressed message-set. We should instead append all retained messages with the configured broker compression type of the topic.
> * While compressing messages we should ideally do some batching before compression.
> * Investigate the use of the client compressor. (See the discussion in the RBs for KAFKA-1374)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)