You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/08/01 09:45:00 UTC
[jira] [Resolved] (PARQUET-2158) Upgrade Hadoop dependency to version 3.2.0
[ https://issues.apache.org/jira/browse/PARQUET-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved PARQUET-2158.
-------------------------------------
Fix Version/s: 1.13.0
Resolution: Fixed
> Upgrade Hadoop dependency to version 3.2.0
> ------------------------------------------
>
> Key: PARQUET-2158
> URL: https://issues.apache.org/jira/browse/PARQUET-2158
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Affects Versions: 1.13.0
> Reporter: Steve Loughran
> Priority: Major
> Fix For: 1.13.0
>
>
> Parquet still builds against Hadoop 2.10. This is very out of date and does not work with java 11, let alone later releases.
> Upgrading the dependency to Hadoop 3.2.0 makes the release compatible with java 11, and lines up with active work on HADOOP-18287, _Provide a shim library for modern FS APIs_
> This will significantly speed up access to columnar data, especially in cloud stores.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)