You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Micah Kornfield <em...@gmail.com> on 2024/06/18 04:40:00 UTC

[DISCUSS] Guidance on new features for parquet-format and releases for parquet-java

As part of the recent discussions on new iterations for Parquet, I put
together a strawman proposal for how we can try to ensure Parquet
implementations still remain widely compatible [1][2]. At a high level
there are three parts:
1.  A proposal to move to a time based release cadence for parquet-java.
2.  Guidance on when forward incompatible features may be enabled.
3.  Guidance on how a new feature is officially adopted into the Parquet
spec.

Some people have already reviewed and there is some contention on how
prescriptive the guidance should be for other implementations, I'd like to
get others viewpoints.  Once we've reached consensus, my intention will be
to have a vote formally ratifying the changes before they are merged.

Thank you to everyone who has provided feedback so far.

Cheers,
Micah

[1] https://github.com/apache/parquet-format/pull/258
[2] https://github.com/apache/parquet-site/pull/61/files

Re: [DISCUSS] Guidance on new features for parquet-format and releases for parquet-java

Posted by Micah Kornfield <em...@gmail.com>.
Hi,
There is still some difference of opinions on
https://github.com/apache/parquet-format/pull/258 for how prescriptive we
should be about waiting on turning on forward incompatible features by
default (and potentially the timeline recommended for doing so).  I'd
appreciate other people's perspectives.

If possible I'd like to start a vote for accepting these changes early next
week.

Thanks,
Micah

On Mon, Jun 17, 2024 at 9:40 PM Micah Kornfield <em...@gmail.com>
wrote:

> As part of the recent discussions on new iterations for Parquet, I put
> together a strawman proposal for how we can try to ensure Parquet
> implementations still remain widely compatible [1][2]. At a high level
> there are three parts:
> 1.  A proposal to move to a time based release cadence for parquet-java.
> 2.  Guidance on when forward incompatible features may be enabled.
> 3.  Guidance on how a new feature is officially adopted into the Parquet
> spec.
>
> Some people have already reviewed and there is some contention on how
> prescriptive the guidance should be for other implementations, I'd like to
> get others viewpoints.  Once we've reached consensus, my intention will be
> to have a vote formally ratifying the changes before they are merged.
>
> Thank you to everyone who has provided feedback so far.
>
> Cheers,
> Micah
>
> [1] https://github.com/apache/parquet-format/pull/258
> [2] https://github.com/apache/parquet-site/pull/61/files
>