You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/06/07 13:31:00 UTC

[jira] [Updated] (PARQUET-2151) Drop Hadoop 2 input stream reflection from parquet-hadoop

     [ https://issues.apache.org/jira/browse/PARQUET-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran updated PARQUET-2151:
------------------------------------
    Summary: Drop Hadoop 2 input stream reflection from parquet-hadoop   (was: Drop Hadoop 1 input stream support from parquet-hadoop )

> Drop Hadoop 2 input stream reflection from parquet-hadoop 
> ----------------------------------------------------------
>
>                 Key: PARQUET-2151
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2151
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>    Affects Versions: 1.13.0
>            Reporter: Steve Loughran
>            Priority: Minor
>
> Parquet uses reflection to load a hadoop2 input stream, falling back to a hadoop-1 compatible client if not found.
> All hadoop 2.0.2+ releases work with H2SeekableInputStream, so H1SeekableInputStream can be cut and the binding to H2SeekableInputStream reworked to avoid needing reflection. This would make it a lot easier to probe for/use the bytebuffer input, and line the code up for more recent hadoop releases.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)