You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/06/13 10:21:00 UTC
[jira] [Created] (PARQUET-2158) Upgrade Hadoop dependency to version 3.2.0
Steve Loughran created PARQUET-2158:
---------------------------------------
Summary: Upgrade Hadoop dependency to version 3.2.0
Key: PARQUET-2158
URL: https://issues.apache.org/jira/browse/PARQUET-2158
Project: Parquet
Issue Type: Improvement
Components: parquet-mr
Affects Versions: 1.13.0
Reporter: Steve Loughran
Parquet still builds against Hadoop 2.10. This is very out of date and does not work with java 11, let alone later releases.
Upgrading the dependency to Hadoop 3.2.0 makes the release compatible with java 11, and lines up with active work on HADOOP-18287, _Provide a shim library for modern FS APIs_
This will significantly speed up access to columnar data, especially in cloud stores.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)