[jira] [Commented] (PARQUET-1142) Avoid leaking Hadoop API to downstream libraries

["Hadrien Kohl (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PARQUET-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781750#comment-16781750 ] 

Hadrien Kohl commented on PARQUET-1142:
---------------------------------------

Right, I think this project has dropin replacements for hadoop CompressionCodecs. It could be a good starting point.
https://github.com/airlift/aircompressor

Is anyone working on this? I could try to get into it if that is part of the roadmap? [~rdblue] do you know others that would like to get involved?

> Avoid leaking Hadoop API to downstream libraries
> ------------------------------------------------
>
>                 Key: PARQUET-1142
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1142
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>    Affects Versions: 1.9.0
>            Reporter: Ryan Blue
>            Assignee: Ryan Blue
>            Priority: Major
>             Fix For: 1.10.0
>
>
> Parquet currently leaks the Hadoop API by requiring callers to pass {{Path}} and {{Configuration}} instances, and by using Hadoop codecs. {{InputFile}} and {{SeekableInputStream}} add alternatives to Hadoop classes in some parts of the read path, but this needs to be extended to the write path and to avoid passing options through {{Configuration}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)