You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/07/02 15:46:00 UTC

[jira] [Commented] (PARQUET-2158) Upgrade Hadoop dependency to version 3.2.0

    [ https://issues.apache.org/jira/browse/PARQUET-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561760#comment-17561760 ] 

ASF GitHub Bot commented on PARQUET-2158:
-----------------------------------------

shangxinli commented on PR #976:
URL: https://github.com/apache/parquet-mr/pull/976#issuecomment-1172918478

   LGTM




> Upgrade Hadoop dependency to version 3.2.0
> ------------------------------------------
>
>                 Key: PARQUET-2158
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2158
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>    Affects Versions: 1.13.0
>            Reporter: Steve Loughran
>            Priority: Major
>
> Parquet still builds against Hadoop 2.10. This is very out of date and does not work with java 11, let alone later releases.
> Upgrading the dependency to Hadoop 3.2.0 makes the release compatible with java 11, and lines up with active work on  HADOOP-18287,  _Provide a shim library for modern FS APIs_ 
> This will significantly speed up access to columnar data, especially  in cloud stores.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)