Re: Arrow Flight SQL status, documentation

[David Li <li...@apache.org>]

An update on things:

The C++ PR [1] has been available for a while now, as has the Java PR and spec [2]. If there's any other feedback from interested people, it would be much appreciated, and thanks to Kyle and his collaborators for getting things implemented, as well as to Micah, Kou, Krisztián, and others for reviews so far.

I think we should start a vote soon, hopefully right after Thanksgiving, since we have two implementations and the proposed protocol.

Note I also filed ARROW-14698 [3] as it would be nice to get some documentation around Flight SQL too at some point.

[1]: https://github.com/apache/arrow/pull/11507
[2]: https://github.com/apache/arrow/pull/10906
[3]: https://issues.apache.org/jira/browse/ARROW-14698

Happy holidays,
David

On Wed, Sep 29, 2021, at 13:31, Kyle Porter (CW) wrote:
> Hey Daniël,
> 
> If there's something in particular that you'd like to know about I'm happy
> to chat further, the Java side of things is mostly there and the C++ side
> is being worked on as David mentioned. We're also working on a JDBC driver
> that is based upon the Java Flight SQL client in parallel.
> 
> Best,
> Kyle
> 
> On Wed, Sep 29, 2021 at 9:34 AM Daniël Heres <da...@gmail.com> wrote:
> 
> > Hi David,
> >
> > Thank you for the full context and the pointers. Glad that this is
> > progressing, I missed the message on the mailing list before. I will have a
> > look at the PR!
> >
> > Best regards,
> >
> > Daniël
> >
> > On Wed, Sep 29, 2021, 14:12 David Li <li...@apache.org> wrote:
> >
> > > It's still in progress, the folks from Dremio are working on a C++
> > > implementation and then I think we will call for a vote. There is nothing
> > > merged as of yet. Any feedback from your perspective would be welcome.
> > >
> > > The protocol definition + Java server/client PR is at:
> > > https://github.com/apache/arrow/pull/10906
> > > The prior ML discussion is at:
> > >
> > https://lists.apache.org/thread.html/r01730723c0ade80f1cf9d231e2af90c754d0df2cc6d6b794b1dcaf71%40%3Cdev.arrow.apache.org%3E
> > >
> > > -David
> > >
> > > On Wed, Sep 29, 2021, at 06:27, Daniël Heres wrote:
> > > > Hi all,
> > > >
> > > > I was wondering if someone can tell me more about the status Arrow
> > Flight
> > > > SQL.
> > > > There are some mentions in recent talks/articles [1], but looking at
> > the
> > > > official documentation [2] and some searching there is no documentation
> > > of
> > > > it I could find.
> > > > For query engines like DataFusion and similar query engines and
> > systems I
> > > > think this could be an interesting addition, compared to using Arrow
> > > Flight
> > > > only.
> > > >
> > > > Best regards,
> > > >
> > > > Daniël Heres
> > > >
> > > > [1]
> > > >
> > >
> > https://www.dremio.com/subsurface/arrow-flight-and-flight-sql-accelerating-data-movement
> > > > [2] https://arrow.apache.org/docs/format/Flight.html
> > > >
> > >
> >
>