You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Manikumar Reddy (JIRA)" <ji...@apache.org> on 2014/09/16 07:13:34 UTC
[jira] [Comment Edited] (KAFKA-1499) Broker-side compression
configuration
[ https://issues.apache.org/jira/browse/KAFKA-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134925#comment-14134925 ]
Manikumar Reddy edited comment on KAFKA-1499 at 9/16/14 5:13 AM:
-----------------------------------------------------------------
[~jjkoshy] I think your are commenting about KAFKA-1374(compaction support for compressed topics). I will update stress test results in couple of days.
Recap of work done in this patch:
1. Introduced new server side config properties *broker.compression.enable* , *broker.compression.type* and per topic override property *compression.type*
2. If broker.compression.enabled=true, then broker will re-compress the received messages to configured compression type, irrespective of their original compression.
was (Author: omkreddy):
[~jjkoshy] I think your are commenting about KAFKA-1374(compaction support for compressed topics). I will update stress results in couple of days.
Recap of work done in this patch:
1. Introduced new server side config properties *broker.compression.enable* , *broker.compression.type* and per topic override property *compression.type*
2. If broker.compression.enabled=true, then broker will re-compress the received messages to configured compression type, irrespective of their original compression.
> Broker-side compression configuration
> -------------------------------------
>
> Key: KAFKA-1499
> URL: https://issues.apache.org/jira/browse/KAFKA-1499
> Project: Kafka
> Issue Type: New Feature
> Reporter: Joel Koshy
> Assignee: Manikumar Reddy
> Labels: newbie++
> Fix For: 0.8.2
>
> Attachments: KAFKA-1499.patch, KAFKA-1499.patch, KAFKA-1499_2014-08-15_14:20:27.patch, KAFKA-1499_2014-08-21_21:44:27.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> A given topic can have messages in mixed compression codecs. i.e., it can
> also have a mix of uncompressed/compressed messages.
> It will be useful to support a broker-side configuration to recompress
> messages to a specific compression codec. i.e., all messages (for all
> topics) on the broker will be compressed to this codec. We could have
> per-topic overrides as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)