You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/10/12 01:42:00 UTC

[jira] [Commented] (PARQUET-2347) Add interface layer between Parquet and Hadoop Configuration

    [ https://issues.apache.org/jira/browse/PARQUET-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774289#comment-17774289 ] 

ASF GitHub Bot commented on PARQUET-2347:
-----------------------------------------

wgtmac commented on PR #1141:
URL: https://github.com/apache/parquet-mr/pull/1141#issuecomment-1758782207

   @shangxinli @gszadovszky Do you have any comment? If not, I plan to merge this next week. Thanks!
   
   @amousavigourabi Could you please resolve the conflicts? Thank you!




> Add interface layer between Parquet and Hadoop Configuration
> ------------------------------------------------------------
>
>                 Key: PARQUET-2347
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2347
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>            Reporter: Atour Mousavi Gourabi
>            Priority: Minor
>
> Parquet relies heavily on a few Hadoop classes, such as its Configuration class, which is used throughout Parquet's reading and writing logic. If we include our own interface for this, this could potentially allow users to use Parquet's readers and writers without the Hadoop dependency later on.
> In order to preserve backward compatibility and avoid breaking downstream projects, the constructors and methods using Hadoop's constructor should be preserved for the time being, though I would favour deprecation in the near future.
> This is part of an effort that has been [discussed on the dev mailing list|https://lists.apache.org/thread/4wl0l3d9dkpx4w69jx3rwnjk034dtqr8].



--
This message was sent by Atlassian Jira
(v8.20.10#820010)