You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Gang Wu (Jira)" <ji...@apache.org> on 2023/10/26 05:35:00 UTC

[jira] [Updated] (PARQUET-2347) Add interface layer between Parquet and Hadoop Configuration

     [ https://issues.apache.org/jira/browse/PARQUET-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gang Wu updated PARQUET-2347:
-----------------------------
    Fix Version/s: 1.14.0

> Add interface layer between Parquet and Hadoop Configuration
> ------------------------------------------------------------
>
>                 Key: PARQUET-2347
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2347
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>            Reporter: Atour Mousavi Gourabi
>            Priority: Minor
>             Fix For: 1.14.0
>
>
> Parquet relies heavily on a few Hadoop classes, such as its Configuration class, which is used throughout Parquet's reading and writing logic. If we include our own interface for this, this could potentially allow users to use Parquet's readers and writers without the Hadoop dependency later on.
> In order to preserve backward compatibility and avoid breaking downstream projects, the constructors and methods using Hadoop's constructor should be preserved for the time being, though I would favour deprecation in the near future.
> This is part of an effort that has been [discussed on the dev mailing list|https://lists.apache.org/thread/4wl0l3d9dkpx4w69jx3rwnjk034dtqr8].



--
This message was sent by Atlassian Jira
(v8.20.10#820010)