[jira] [Comment Edited] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

["James Oliver (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169616#comment-14169616 ] 

James Oliver edited comment on KAFKA-1493 at 10/13/14 7:41 PM:
---------------------------------------------------------------

The i/o streams provided in the patch are nearly identical to the i/o streams in lz4-java. As it stands, I don't think it buys us much. Other than that, looks good, just a few spots still referring to lz4hc (I think KAFKA-1471 changes were applied to trunk after this patch was created).

This details the formal specification 
http://fastcompression.blogspot.com/2013/04/lz4-streaming-format-final.html

Here's an example C++ implementation of that format:
https://github.com/t-mat/lz4mt/blob/master/src/lz4mt.cpp

We still need a Java implementation


was (Author: joliver):
Sure, I'll take a look at it now.

> Use a well-documented LZ4 compression format and remove redundant LZ4HC option
> ------------------------------------------------------------------------------
>
>                 Key: KAFKA-1493
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1493
>             Project: Kafka
>          Issue Type: Improvement
>    Affects Versions: 0.8.2
>            Reporter: James Oliver
>            Assignee: Ivan Lyutov
>            Priority: Blocker
>             Fix For: 0.8.2
>
>         Attachments: KAFKA-1493.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)