You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Antoine Pitrou <an...@python.org> on 2024/08/05 13:27:11 UTC
Re: [DISCUSS] Parquet extensions
Hi Alkis,
I made a couple belated comments but they are pretty minor. In general
this looks good to me. Thank you!
Regards
Antoine.
On Fri, 21 Jun 2024 10:29:27 +0200
Alkis Evlogimenos
<al...@databricks.com.INVALID>
wrote:
> Hey folks.
>
> I want to move the extension PR
> <https://github.com/apache/parquet-format/pull/254> forward. Unfortunately
> the discussion was spread across the PR, other threads and documents making
> it slow to progress. To avoid further fragmentation I have put together a
> document
> <https://docs.google.com/document/d/1KkoR0DjzYnLQXO-d0oRBv2k157IZU0_injqd4eV4WiI/edit>
> discussing the extensions mechanism in isolation. I believe the document
> addresses all the concerns/comments from the PR and mailing list
> discussions brought forward so far.
>
> I propose we continue the discussion in the document and once everything is
> addressed, we finalize the PR.
>
> Thank you,
>
Re: [DISCUSS] Parquet extensions
Posted by Alkis Evlogimenos <al...@databricks.com.INVALID>.
Thank you for the input Antoine.
I updated the PR with the latest from the document. Shall we move the
discussion on the PR since that's the thing that will end up in the spec?
https://github.com/apache/parquet-format/pull/254
On Mon, Aug 5, 2024 at 4:36 PM Antoine Pitrou <an...@python.org> wrote:
>
> Actually, I have a terminology suggestion: can we perhaps use another
> name than "extension"? The reason is that we might want to an extension
> type mechanism as I vaguely proposed in
> https://lists.apache.org/thread/9xo3mp4n23p8psmrhso5t9q899vxwfjt.
>
> (and the term "extension type" itself mirrors Apache Arrow
> terminology)
>
> We could perhaps call these "Parquet protocol experiments".
>
> Regards
>
> Antoine.
>
>
> On Mon, 5 Aug 2024 15:27:11 +0200
> Antoine Pitrou <an...@python.org> wrote:
> > Hi Alkis,
> >
> > I made a couple belated comments but they are pretty minor. In general
> > this looks good to me. Thank you!
> >
> > Regards
> >
> > Antoine.
> >
> >
> > On Fri, 21 Jun 2024 10:29:27 +0200
> > Alkis Evlogimenos
> > <al...@databricks.com.INVALID>
> > wrote:
> > > Hey folks.
> > >
> > > I want to move the extension PR
> > > <https://github.com/apache/parquet-format/pull/254> forward.
> Unfortunately
> > > the discussion was spread across the PR, other threads and documents
> making
> > > it slow to progress. To avoid further fragmentation I have put
> together a
> > > document
> > > <
> https://docs.google.com/document/d/1KkoR0DjzYnLQXO-d0oRBv2k157IZU0_injqd4eV4WiI/edit
> >
> > > discussing the extensions mechanism in isolation. I believe the
> document
> > > addresses all the concerns/comments from the PR and mailing list
> > > discussions brought forward so far.
> > >
> > > I propose we continue the discussion in the document and once
> everything is
> > > addressed, we finalize the PR.
> > >
> > > Thank you,
> > >
> >
> >
> >
> >
>
>
>
>
Re: [DISCUSS] Parquet extensions
Posted by Antoine Pitrou <an...@python.org>.
Actually, I have a terminology suggestion: can we perhaps use another
name than "extension"? The reason is that we might want to an extension
type mechanism as I vaguely proposed in
https://lists.apache.org/thread/9xo3mp4n23p8psmrhso5t9q899vxwfjt.
(and the term "extension type" itself mirrors Apache Arrow
terminology)
We could perhaps call these "Parquet protocol experiments".
Regards
Antoine.
On Mon, 5 Aug 2024 15:27:11 +0200
Antoine Pitrou <an...@python.org> wrote:
> Hi Alkis,
>
> I made a couple belated comments but they are pretty minor. In general
> this looks good to me. Thank you!
>
> Regards
>
> Antoine.
>
>
> On Fri, 21 Jun 2024 10:29:27 +0200
> Alkis Evlogimenos
> <al...@databricks.com.INVALID>
> wrote:
> > Hey folks.
> >
> > I want to move the extension PR
> > <https://github.com/apache/parquet-format/pull/254> forward. Unfortunately
> > the discussion was spread across the PR, other threads and documents making
> > it slow to progress. To avoid further fragmentation I have put together a
> > document
> > <https://docs.google.com/document/d/1KkoR0DjzYnLQXO-d0oRBv2k157IZU0_injqd4eV4WiI/edit>
> > discussing the extensions mechanism in isolation. I believe the document
> > addresses all the concerns/comments from the PR and mailing list
> > discussions brought forward so far.
> >
> > I propose we continue the discussion in the document and once everything is
> > addressed, we finalize the PR.
> >
> > Thank you,
> >
>
>
>
>