You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Sutou Kouhei <ko...@clear-code.com> on 2023/05/04 07:25:43 UTC
[VOTE][Format][Flight] Ordered data support
Hi,
I would like to propose ordered data support for Flight RPC.
See the following pull request and discussion for details:
* GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
https://github.com/apache/arrow/pull/35178
Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
* [DISCUSS][Format][Flight] Ordered data support
https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
This is based on one of the following proposals:
[DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
Summary:
* Before:
There is no ordering defined on endpoints or the data
within.
After:
FlightInfo.ordered is added. If FlightInfo.ordered is
true, this signals there is some order between data from
different endpoints.
* Motivation: We can optimize a sorted results case by
FlightInfo.ordered. A client needs to sort by itself even
when a Flight RPC system returns sorted results without
FlightInfo.ordered. Because a client can't know whether
results are sorted or not.
* This proposal does NOT break a backward
compatibility. Because clients can ignore
FlightInfo.ordered.
* The pull request includes reference implementations for
C++, Go and Java.
The vote will be open for at least 72 hours.
[ ] +1 Accept this proposal
[ ] +0
[ ] -1 Do not accept this proposal because...
Thanks,
--
kou
[RESULT][VOTE][Format][Flight] Ordered data support
Posted by Sutou Kouhei <ko...@apache.org>.
Hi,
The vote carries with 4 +1 binding votes, 1 +1 non-binding
vote and no -1 votes.
I'll merge https://github.com/apache/arrow/pull/35178 .
Thanks,
--
kou
In <20...@clear-code.com>
"[VOTE][Format][Flight] Ordered data support" on Thu, 04 May 2023 16:25:43 +0900 (JST),
Sutou Kouhei <ko...@clear-code.com> wrote:
> Hi,
>
> I would like to propose ordered data support for Flight RPC.
>
> See the following pull request and discussion for details:
>
> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> https://github.com/apache/arrow/pull/35178
>
> Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
>
> * [DISCUSS][Format][Flight] Ordered data support
> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
>
> This is based on one of the following proposals:
>
> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
>
> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
>
> Summary:
>
> * Before:
> There is no ordering defined on endpoints or the data
> within.
>
> After:
> FlightInfo.ordered is added. If FlightInfo.ordered is
> true, this signals there is some order between data from
> different endpoints.
>
> * Motivation: We can optimize a sorted results case by
> FlightInfo.ordered. A client needs to sort by itself even
> when a Flight RPC system returns sorted results without
> FlightInfo.ordered. Because a client can't know whether
> results are sorted or not.
>
> * This proposal does NOT break a backward
> compatibility. Because clients can ignore
> FlightInfo.ordered.
>
> * The pull request includes reference implementations for
> C++, Go and Java.
>
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Accept this proposal
> [ ] +0
> [ ] -1 Do not accept this proposal because...
>
>
> Thanks,
> --
> kou
Re: [VOTE][Format][Flight] Ordered data support
Posted by Matthew Topol <ma...@voltrondata.com.INVALID>.
+1 Thanks Kou!
On Thu, May 4, 2023 at 6:00 AM Andrew Lamb <al...@influxdata.com> wrote:
> +1
>
> Thanks Kou!
>
> On Thu, May 4, 2023 at 6:57 AM David Li <li...@apache.org> wrote:
>
> > +1
> >
> > Thanks Kou!
> >
> > On Thu, May 4, 2023, at 05:09, Jean-Baptiste Onofré wrote:
> > > +1 (non binding)
> > >
> > > Regards
> > > JB
> > >
> > > On Thu, May 4, 2023 at 9:25 AM Sutou Kouhei <ko...@clear-code.com>
> wrote:
> > >>
> > >> Hi,
> > >>
> > >> I would like to propose ordered data support for Flight RPC.
> > >>
> > >> See the following pull request and discussion for details:
> > >>
> > >> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> > >> https://github.com/apache/arrow/pull/35178
> > >>
> > >> Preview:
> > http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
> > >>
> > >> * [DISCUSS][Format][Flight] Ordered data support
> > >> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
> > >>
> > >> This is based on one of the following proposals:
> > >>
> > >> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> > >> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
> > >>
> > >> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> > >>
> >
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
> > >>
> > >> Summary:
> > >>
> > >> * Before:
> > >> There is no ordering defined on endpoints or the data
> > >> within.
> > >>
> > >> After:
> > >> FlightInfo.ordered is added. If FlightInfo.ordered is
> > >> true, this signals there is some order between data from
> > >> different endpoints.
> > >>
> > >> * Motivation: We can optimize a sorted results case by
> > >> FlightInfo.ordered. A client needs to sort by itself even
> > >> when a Flight RPC system returns sorted results without
> > >> FlightInfo.ordered. Because a client can't know whether
> > >> results are sorted or not.
> > >>
> > >> * This proposal does NOT break a backward
> > >> compatibility. Because clients can ignore
> > >> FlightInfo.ordered.
> > >>
> > >> * The pull request includes reference implementations for
> > >> C++, Go and Java.
> > >>
> > >>
> > >> The vote will be open for at least 72 hours.
> > >>
> > >> [ ] +1 Accept this proposal
> > >> [ ] +0
> > >> [ ] -1 Do not accept this proposal because...
> > >>
> > >>
> > >> Thanks,
> > >> --
> > >> kou
> >
>
Re: [VOTE][Format][Flight] Ordered data support
Posted by Andrew Lamb <al...@influxdata.com>.
+1
Thanks Kou!
On Thu, May 4, 2023 at 6:57 AM David Li <li...@apache.org> wrote:
> +1
>
> Thanks Kou!
>
> On Thu, May 4, 2023, at 05:09, Jean-Baptiste Onofré wrote:
> > +1 (non binding)
> >
> > Regards
> > JB
> >
> > On Thu, May 4, 2023 at 9:25 AM Sutou Kouhei <ko...@clear-code.com> wrote:
> >>
> >> Hi,
> >>
> >> I would like to propose ordered data support for Flight RPC.
> >>
> >> See the following pull request and discussion for details:
> >>
> >> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> >> https://github.com/apache/arrow/pull/35178
> >>
> >> Preview:
> http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
> >>
> >> * [DISCUSS][Format][Flight] Ordered data support
> >> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
> >>
> >> This is based on one of the following proposals:
> >>
> >> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> >> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
> >>
> >> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> >>
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
> >>
> >> Summary:
> >>
> >> * Before:
> >> There is no ordering defined on endpoints or the data
> >> within.
> >>
> >> After:
> >> FlightInfo.ordered is added. If FlightInfo.ordered is
> >> true, this signals there is some order between data from
> >> different endpoints.
> >>
> >> * Motivation: We can optimize a sorted results case by
> >> FlightInfo.ordered. A client needs to sort by itself even
> >> when a Flight RPC system returns sorted results without
> >> FlightInfo.ordered. Because a client can't know whether
> >> results are sorted or not.
> >>
> >> * This proposal does NOT break a backward
> >> compatibility. Because clients can ignore
> >> FlightInfo.ordered.
> >>
> >> * The pull request includes reference implementations for
> >> C++, Go and Java.
> >>
> >>
> >> The vote will be open for at least 72 hours.
> >>
> >> [ ] +1 Accept this proposal
> >> [ ] +0
> >> [ ] -1 Do not accept this proposal because...
> >>
> >>
> >> Thanks,
> >> --
> >> kou
>
Re: [VOTE][Format][Flight] Ordered data support
Posted by David Li <li...@apache.org>.
+1
Thanks Kou!
On Thu, May 4, 2023, at 05:09, Jean-Baptiste Onofré wrote:
> +1 (non binding)
>
> Regards
> JB
>
> On Thu, May 4, 2023 at 9:25 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>>
>> Hi,
>>
>> I would like to propose ordered data support for Flight RPC.
>>
>> See the following pull request and discussion for details:
>>
>> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
>> https://github.com/apache/arrow/pull/35178
>>
>> Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
>>
>> * [DISCUSS][Format][Flight] Ordered data support
>> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
>>
>> This is based on one of the following proposals:
>>
>> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
>> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
>>
>> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
>> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
>>
>> Summary:
>>
>> * Before:
>> There is no ordering defined on endpoints or the data
>> within.
>>
>> After:
>> FlightInfo.ordered is added. If FlightInfo.ordered is
>> true, this signals there is some order between data from
>> different endpoints.
>>
>> * Motivation: We can optimize a sorted results case by
>> FlightInfo.ordered. A client needs to sort by itself even
>> when a Flight RPC system returns sorted results without
>> FlightInfo.ordered. Because a client can't know whether
>> results are sorted or not.
>>
>> * This proposal does NOT break a backward
>> compatibility. Because clients can ignore
>> FlightInfo.ordered.
>>
>> * The pull request includes reference implementations for
>> C++, Go and Java.
>>
>>
>> The vote will be open for at least 72 hours.
>>
>> [ ] +1 Accept this proposal
>> [ ] +0
>> [ ] -1 Do not accept this proposal because...
>>
>>
>> Thanks,
>> --
>> kou
Re: [VOTE][Format][Flight] Ordered data support
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
+1 (non binding)
Regards
JB
On Thu, May 4, 2023 at 9:25 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>
> Hi,
>
> I would like to propose ordered data support for Flight RPC.
>
> See the following pull request and discussion for details:
>
> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> https://github.com/apache/arrow/pull/35178
>
> Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
>
> * [DISCUSS][Format][Flight] Ordered data support
> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
>
> This is based on one of the following proposals:
>
> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
>
> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
>
> Summary:
>
> * Before:
> There is no ordering defined on endpoints or the data
> within.
>
> After:
> FlightInfo.ordered is added. If FlightInfo.ordered is
> true, this signals there is some order between data from
> different endpoints.
>
> * Motivation: We can optimize a sorted results case by
> FlightInfo.ordered. A client needs to sort by itself even
> when a Flight RPC system returns sorted results without
> FlightInfo.ordered. Because a client can't know whether
> results are sorted or not.
>
> * This proposal does NOT break a backward
> compatibility. Because clients can ignore
> FlightInfo.ordered.
>
> * The pull request includes reference implementations for
> C++, Go and Java.
>
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Accept this proposal
> [ ] +0
> [ ] -1 Do not accept this proposal because...
>
>
> Thanks,
> --
> kou
Re: [VOTE][Format][Flight] Ordered data support
Posted by Sutou Kouhei <ko...@clear-code.com>.
+1
In <20...@clear-code.com>
"[VOTE][Format][Flight] Ordered data support" on Thu, 04 May 2023 16:25:43 +0900 (JST),
Sutou Kouhei <ko...@clear-code.com> wrote:
> Hi,
>
> I would like to propose ordered data support for Flight RPC.
>
> See the following pull request and discussion for details:
>
> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> https://github.com/apache/arrow/pull/35178
>
> Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
>
> * [DISCUSS][Format][Flight] Ordered data support
> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
>
> This is based on one of the following proposals:
>
> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
>
> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
>
> Summary:
>
> * Before:
> There is no ordering defined on endpoints or the data
> within.
>
> After:
> FlightInfo.ordered is added. If FlightInfo.ordered is
> true, this signals there is some order between data from
> different endpoints.
>
> * Motivation: We can optimize a sorted results case by
> FlightInfo.ordered. A client needs to sort by itself even
> when a Flight RPC system returns sorted results without
> FlightInfo.ordered. Because a client can't know whether
> results are sorted or not.
>
> * This proposal does NOT break a backward
> compatibility. Because clients can ignore
> FlightInfo.ordered.
>
> * The pull request includes reference implementations for
> C++, Go and Java.
>
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Accept this proposal
> [ ] +0
> [ ] -1 Do not accept this proposal because...
>
>
> Thanks,
> --
> kou
Re: [VOTE][Format][Flight] Ordered data support
Posted by Sutou Kouhei <ko...@clear-code.com>.
Hi,
The vote carries with 4 +1 binding votes, 1 +1 non-binding
vote and no -1 votes.
I'll merge https://github.com/apache/arrow/pull/35178 .
Thanks,
--
kou
In <20...@clear-code.com>
"[VOTE][Format][Flight] Ordered data support" on Thu, 04 May 2023 16:25:43 +0900 (JST),
Sutou Kouhei <ko...@clear-code.com> wrote:
> Hi,
>
> I would like to propose ordered data support for Flight RPC.
>
> See the following pull request and discussion for details:
>
> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> https://github.com/apache/arrow/pull/35178
>
> Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
>
> * [DISCUSS][Format][Flight] Ordered data support
> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
>
> This is based on one of the following proposals:
>
> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
>
> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
>
> Summary:
>
> * Before:
> There is no ordering defined on endpoints or the data
> within.
>
> After:
> FlightInfo.ordered is added. If FlightInfo.ordered is
> true, this signals there is some order between data from
> different endpoints.
>
> * Motivation: We can optimize a sorted results case by
> FlightInfo.ordered. A client needs to sort by itself even
> when a Flight RPC system returns sorted results without
> FlightInfo.ordered. Because a client can't know whether
> results are sorted or not.
>
> * This proposal does NOT break a backward
> compatibility. Because clients can ignore
> FlightInfo.ordered.
>
> * The pull request includes reference implementations for
> C++, Go and Java.
>
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Accept this proposal
> [ ] +0
> [ ] -1 Do not accept this proposal because...
>
>
> Thanks,
> --
> kou
Re: [VOTE][Format][Flight] Ordered data support
Posted by Sutou Kouhei <ko...@clear-code.com>.
Hi,
The vote carries with 4 +1 binding votes, 1 +1 non-binding
vote and no -1 votes.
I'll merge https://github.com/apache/arrow/pull/35178 .
Thanks,
--
kou
In <20...@clear-code.com>
"[VOTE][Format][Flight] Ordered data support" on Thu, 04 May 2023 16:25:43 +0900 (JST),
Sutou Kouhei <ko...@clear-code.com> wrote:
> Hi,
>
> I would like to propose ordered data support for Flight RPC.
>
> See the following pull request and discussion for details:
>
> * GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
> https://github.com/apache/arrow/pull/35178
>
> Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html
>
> * [DISCUSS][Format][Flight] Ordered data support
> https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
>
> This is based on one of the following proposals:
>
> [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
> https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
>
> Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
> https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq
>
> Summary:
>
> * Before:
> There is no ordering defined on endpoints or the data
> within.
>
> After:
> FlightInfo.ordered is added. If FlightInfo.ordered is
> true, this signals there is some order between data from
> different endpoints.
>
> * Motivation: We can optimize a sorted results case by
> FlightInfo.ordered. A client needs to sort by itself even
> when a Flight RPC system returns sorted results without
> FlightInfo.ordered. Because a client can't know whether
> results are sorted or not.
>
> * This proposal does NOT break a backward
> compatibility. Because clients can ignore
> FlightInfo.ordered.
>
> * The pull request includes reference implementations for
> C++, Go and Java.
>
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Accept this proposal
> [ ] +0
> [ ] -1 Do not accept this proposal because...
>
>
> Thanks,
> --
> kou