You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Micah Kornfield <em...@gmail.com> on 2020/05/02 22:13:21 UTC
Re: [RESULT] [VOTE] Add "trivial" RecordBatch body compression to
Arrow IPC protocol
Hi Wes,
Will you have time open JIRAs on tracking implementations in each
language? I can try to do it sometime this week if not.
Thanks,
Micah
On Thu, Apr 30, 2020 at 2:49 PM Wes McKinney <we...@gmail.com> wrote:
> The vote carries with 7 binding +1 votes and 1 non-binding +1
>
> On Fri, Apr 24, 2020 at 7:40 AM Francois Saint-Jacques
> <fs...@gmail.com> wrote:
> >
> > +1 (binding)
> >
> > On Fri, Apr 24, 2020 at 5:41 AM Krisztián Szűcs
> > <sz...@gmail.com> wrote:
> > >
> > > +1 (binding)
> > >
> > > On 2020. Apr 24., Fri at 1:51, Micah Kornfield <em...@gmail.com>
> > > wrote:
> > >
> > > > +1 (binding)
> > > >
> > > > On Thu, Apr 23, 2020 at 2:35 PM Sutou Kouhei <ko...@clear-code.com>
> wrote:
> > > >
> > > > > +1 (binding)
> > > > >
> > > > > In <
> CAJPUwMDEm1-5SUDxZRwYfkHSDEFssq8TbspGyicaJhKBEfUT+Q@mail.gmail.com>
> > > > > "[VOTE] Add "trivial" RecordBatch body compression to Arrow IPC
> > > > > protocol" on Wed, 22 Apr 2020 19:24:09 -0500,
> > > > > Wes McKinney <we...@gmail.com> wrote:
> > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I have proposed adding a simple RecordBatch IPC message body
> > > > > > compression scheme (using either LZ4 or ZSTD) to the Arrow IPC
> > > > > > protocol in GitHub PR [1] as discussed on the mailing list [2].
> This
> > > > > > is distinct from separate discussions about adding in-memory
> encodings
> > > > > > (like RLE-encoding) to the Arrow columnar format.
> > > > > >
> > > > > > This change is not forward compatible so it will not be safe to
> send
> > > > > > compressed messages to old libraries, but since we are still
> pre-1.0.0
> > > > > > the consensus is that this is acceptable. We may separately
> consider
> > > > > > increasing the metadata version for 1.0.0 to require clients to
> > > > > > upgrade.
> > > > > >
> > > > > > Please vote whether to accept the addition. The vote will be
> open for
> > > > > > at least 72 hours.
> > > > > >
> > > > > > [ ] +1 Accept this addition to the IPC protocol
> > > > > > [ ] +0
> > > > > > [ ] -1 Do not accept the changes because...
> > > > > >
> > > > > > Here is my vote: +1
> > > > > >
> > > > > > Thanks,
> > > > > > Wes
> > > > > >
> > > > > > [1]: https://github.com/apache/arrow/pull/6707
> > > > > > [2]:
> > > > >
> > > >
> https://lists.apache.org/thread.html/r58c9d23ad159644fca590d8f841df80d180b11bfb72f949d601d764b%40%3Cdev.arrow.apache.org%3E
> > > > >
> > > >
>
Re: [RESULT] [VOTE] Add "trivial" RecordBatch body compression to
Arrow IPC protocol
Posted by Wes McKinney <we...@gmail.com>.
hi Micah,
I'll take care of it shortly.
Thanks
On Sat, May 2, 2020 at 5:13 PM Micah Kornfield <em...@gmail.com> wrote:
>
> Hi Wes,
> Will you have time open JIRAs on tracking implementations in each
> language? I can try to do it sometime this week if not.
>
> Thanks,
> Micah
>
> On Thu, Apr 30, 2020 at 2:49 PM Wes McKinney <we...@gmail.com> wrote:
>
> > The vote carries with 7 binding +1 votes and 1 non-binding +1
> >
> > On Fri, Apr 24, 2020 at 7:40 AM Francois Saint-Jacques
> > <fs...@gmail.com> wrote:
> > >
> > > +1 (binding)
> > >
> > > On Fri, Apr 24, 2020 at 5:41 AM Krisztián Szűcs
> > > <sz...@gmail.com> wrote:
> > > >
> > > > +1 (binding)
> > > >
> > > > On 2020. Apr 24., Fri at 1:51, Micah Kornfield <em...@gmail.com>
> > > > wrote:
> > > >
> > > > > +1 (binding)
> > > > >
> > > > > On Thu, Apr 23, 2020 at 2:35 PM Sutou Kouhei <ko...@clear-code.com>
> > wrote:
> > > > >
> > > > > > +1 (binding)
> > > > > >
> > > > > > In <
> > CAJPUwMDEm1-5SUDxZRwYfkHSDEFssq8TbspGyicaJhKBEfUT+Q@mail.gmail.com>
> > > > > > "[VOTE] Add "trivial" RecordBatch body compression to Arrow IPC
> > > > > > protocol" on Wed, 22 Apr 2020 19:24:09 -0500,
> > > > > > Wes McKinney <we...@gmail.com> wrote:
> > > > > >
> > > > > > > Hello,
> > > > > > >
> > > > > > > I have proposed adding a simple RecordBatch IPC message body
> > > > > > > compression scheme (using either LZ4 or ZSTD) to the Arrow IPC
> > > > > > > protocol in GitHub PR [1] as discussed on the mailing list [2].
> > This
> > > > > > > is distinct from separate discussions about adding in-memory
> > encodings
> > > > > > > (like RLE-encoding) to the Arrow columnar format.
> > > > > > >
> > > > > > > This change is not forward compatible so it will not be safe to
> > send
> > > > > > > compressed messages to old libraries, but since we are still
> > pre-1.0.0
> > > > > > > the consensus is that this is acceptable. We may separately
> > consider
> > > > > > > increasing the metadata version for 1.0.0 to require clients to
> > > > > > > upgrade.
> > > > > > >
> > > > > > > Please vote whether to accept the addition. The vote will be
> > open for
> > > > > > > at least 72 hours.
> > > > > > >
> > > > > > > [ ] +1 Accept this addition to the IPC protocol
> > > > > > > [ ] +0
> > > > > > > [ ] -1 Do not accept the changes because...
> > > > > > >
> > > > > > > Here is my vote: +1
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Wes
> > > > > > >
> > > > > > > [1]: https://github.com/apache/arrow/pull/6707
> > > > > > > [2]:
> > > > > >
> > > > >
> > https://lists.apache.org/thread.html/r58c9d23ad159644fca590d8f841df80d180b11bfb72f949d601d764b%40%3Cdev.arrow.apache.org%3E
> > > > > >
> > > > >
> >