You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2016/01/13 23:32:39 UTC

[jira] [Commented] (FLUME-2720) HDFS Sink: Autogenerate LZO indexes while creating LZO files

    [ https://issues.apache.org/jira/browse/FLUME-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097155#comment-15097155 ] 

Jarek Jarcec Cecho commented on FLUME-2720:
-------------------------------------------

Thanks for the patch [~hariprasad kuppuswamy]. I like the idea of making it simpler and auto-generate the LZO indexes. Sadly the LZO libraries are shared under GPL license that [is not compatible with ASLv2|http://www.apache.org/legal/resolved.html] and therefore we can't accept this improvement :(

> HDFS Sink: Autogenerate LZO indexes while creating LZO files
> ------------------------------------------------------------
>
>                 Key: FLUME-2720
>                 URL: https://issues.apache.org/jira/browse/FLUME-2720
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: v1.7.0
>            Reporter: Hari
>            Priority: Minor
>         Attachments: 0001-FLUME-2720-Autogenerate-LZO-indexes-while-creating-L.patch
>
>
> The LZO indexes are now generated offline using DistributedLZOIndexer. 
> It will be nice to auto generate these index files during the ingestion itself.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)