You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2016/01/13 23:32:39 UTC
[jira] [Commented] (FLUME-2720) HDFS Sink: Autogenerate LZO indexes
while creating LZO files
[ https://issues.apache.org/jira/browse/FLUME-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097155#comment-15097155 ]
Jarek Jarcec Cecho commented on FLUME-2720:
-------------------------------------------
Thanks for the patch [~hariprasad kuppuswamy]. I like the idea of making it simpler and auto-generate the LZO indexes. Sadly the LZO libraries are shared under GPL license that [is not compatible with ASLv2|http://www.apache.org/legal/resolved.html] and therefore we can't accept this improvement :(
> HDFS Sink: Autogenerate LZO indexes while creating LZO files
> ------------------------------------------------------------
>
> Key: FLUME-2720
> URL: https://issues.apache.org/jira/browse/FLUME-2720
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.7.0
> Reporter: Hari
> Priority: Minor
> Attachments: 0001-FLUME-2720-Autogenerate-LZO-indexes-while-creating-L.patch
>
>
> The LZO indexes are now generated offline using DistributedLZOIndexer.
> It will be nice to auto generate these index files during the ingestion itself.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)