You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Kirill Lykov <ly...@gmail.com> on 2021/03/11 17:33:09 UTC
Question about joining two tables
Hi,
Is it possible somehow using existing compute functionality or some other
code to join two tables by values in a common column?
--
Best regards,
Kirill Lykov
Re: Question about joining two tables
Posted by Benjamin Kietzman <be...@gmail.com>.
For future design docs/proposals, I've created:
https://cwiki.apache.org/confluence/display/ARROW/from+the+mailing+list
I'll append to that list as I see new docs come up.
On Thu, Mar 11, 2021 at 10:33 PM Aldrin <ak...@ucsc.edu.invalid> wrote:
> Great, thanks for the responses! That all makes sense :)
>
> On Thu, Mar 11, 2021 at 1:29 PM Benjamin Kietzman <be...@gmail.com>
> wrote:
>
> > Hi Aldrin,
> >
> > We don't have a unified repository for design docs that I'm aware of.
> > Governance-wise only JIRA and the mailing lists are canonical, but
> > IIUC it'd be legal, straightforward, and beneficial to provide a
> directory
> > like the one you describe of "design docs proposed to the ML" or so.
> >
> > Ben Kietzman
> >
> > On Thu, Mar 11, 2021 at 3:02 PM Wes McKinney <we...@gmail.com>
> wrote:
> >
> > > This is a new document that we just started earlier this week. I'd put
> > > together some docs in the past to try to bootstrap community
> > > organization on this, but since we're now finally putting hands to
> > > code after setting up some critical dependencies (like the Datasets
> > > interface, which is needed to implement scans, and the array
> > > function/kernels framework), the documents + supporting Jira issues
> > > will be more specifically about an implementation plan. We'd welcome
> > > participation from anyone who is interested in this critical project.
> > >
> > > On Thu, Mar 11, 2021 at 1:55 PM Aldrin <ak...@ucsc.edu.invalid>
> > wrote:
> > > >
> > > > Hi Ben, thanks for the link!
> > > >
> > > > I will eventually be interested in this direction as well, but hadn't
> > > seen
> > > > this document. Is there a place where these design documents can be
> > > found?
> > > > I've seen this and a few other google doc links floating around the
> > > mailing
> > > > list but I can't figure out how to navigate to a google drive or a
> page
> > > > enumerating the various documents.
> > > >
> > > > Thank you!
> > > >
> > > > Aldrin Montana
> > > > Computer Science PhD Student
> > > > UC Santa Cruz
> > > >
> > > >
> > > > On Thu, Mar 11, 2021 at 10:07 AM Benjamin Kietzman <
> > bengilgit@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > This is not yet implemented but it is on the roadmap for the near
> > > future:
> > > > >
> > > > >
> > >
> >
> https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
> > > > >
> > > > > Ben Kietzman
> > > > >
> > > > > On Thu, Mar 11, 2021 at 12:33 PM Kirill Lykov <
> > lykov.kirill@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > Is it possible somehow using existing compute functionality or
> some
> > > other
> > > > > > code to join two tables by values in a common column?
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > > Kirill Lykov
> > > > > >
> > > > >
> > >
> >
> --
>
> Aldrin Montana
> Computer Science PhD Student
> UC Santa Cruz
>
Re: Question about joining two tables
Posted by Aldrin <ak...@ucsc.edu.INVALID>.
Great, thanks for the responses! That all makes sense :)
On Thu, Mar 11, 2021 at 1:29 PM Benjamin Kietzman <be...@gmail.com>
wrote:
> Hi Aldrin,
>
> We don't have a unified repository for design docs that I'm aware of.
> Governance-wise only JIRA and the mailing lists are canonical, but
> IIUC it'd be legal, straightforward, and beneficial to provide a directory
> like the one you describe of "design docs proposed to the ML" or so.
>
> Ben Kietzman
>
> On Thu, Mar 11, 2021 at 3:02 PM Wes McKinney <we...@gmail.com> wrote:
>
> > This is a new document that we just started earlier this week. I'd put
> > together some docs in the past to try to bootstrap community
> > organization on this, but since we're now finally putting hands to
> > code after setting up some critical dependencies (like the Datasets
> > interface, which is needed to implement scans, and the array
> > function/kernels framework), the documents + supporting Jira issues
> > will be more specifically about an implementation plan. We'd welcome
> > participation from anyone who is interested in this critical project.
> >
> > On Thu, Mar 11, 2021 at 1:55 PM Aldrin <ak...@ucsc.edu.invalid>
> wrote:
> > >
> > > Hi Ben, thanks for the link!
> > >
> > > I will eventually be interested in this direction as well, but hadn't
> > seen
> > > this document. Is there a place where these design documents can be
> > found?
> > > I've seen this and a few other google doc links floating around the
> > mailing
> > > list but I can't figure out how to navigate to a google drive or a page
> > > enumerating the various documents.
> > >
> > > Thank you!
> > >
> > > Aldrin Montana
> > > Computer Science PhD Student
> > > UC Santa Cruz
> > >
> > >
> > > On Thu, Mar 11, 2021 at 10:07 AM Benjamin Kietzman <
> bengilgit@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > This is not yet implemented but it is on the roadmap for the near
> > future:
> > > >
> > > >
> >
> https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
> > > >
> > > > Ben Kietzman
> > > >
> > > > On Thu, Mar 11, 2021 at 12:33 PM Kirill Lykov <
> lykov.kirill@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Is it possible somehow using existing compute functionality or some
> > other
> > > > > code to join two tables by values in a common column?
> > > > >
> > > > > --
> > > > > Best regards,
> > > > > Kirill Lykov
> > > > >
> > > >
> >
>
--
Aldrin Montana
Computer Science PhD Student
UC Santa Cruz
Re: Question about joining two tables
Posted by Benjamin Kietzman <be...@gmail.com>.
Hi Aldrin,
We don't have a unified repository for design docs that I'm aware of.
Governance-wise only JIRA and the mailing lists are canonical, but
IIUC it'd be legal, straightforward, and beneficial to provide a directory
like the one you describe of "design docs proposed to the ML" or so.
Ben Kietzman
On Thu, Mar 11, 2021 at 3:02 PM Wes McKinney <we...@gmail.com> wrote:
> This is a new document that we just started earlier this week. I'd put
> together some docs in the past to try to bootstrap community
> organization on this, but since we're now finally putting hands to
> code after setting up some critical dependencies (like the Datasets
> interface, which is needed to implement scans, and the array
> function/kernels framework), the documents + supporting Jira issues
> will be more specifically about an implementation plan. We'd welcome
> participation from anyone who is interested in this critical project.
>
> On Thu, Mar 11, 2021 at 1:55 PM Aldrin <ak...@ucsc.edu.invalid> wrote:
> >
> > Hi Ben, thanks for the link!
> >
> > I will eventually be interested in this direction as well, but hadn't
> seen
> > this document. Is there a place where these design documents can be
> found?
> > I've seen this and a few other google doc links floating around the
> mailing
> > list but I can't figure out how to navigate to a google drive or a page
> > enumerating the various documents.
> >
> > Thank you!
> >
> > Aldrin Montana
> > Computer Science PhD Student
> > UC Santa Cruz
> >
> >
> > On Thu, Mar 11, 2021 at 10:07 AM Benjamin Kietzman <be...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > This is not yet implemented but it is on the roadmap for the near
> future:
> > >
> > >
> https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
> > >
> > > Ben Kietzman
> > >
> > > On Thu, Mar 11, 2021 at 12:33 PM Kirill Lykov <ly...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > Is it possible somehow using existing compute functionality or some
> other
> > > > code to join two tables by values in a common column?
> > > >
> > > > --
> > > > Best regards,
> > > > Kirill Lykov
> > > >
> > >
>
Re: Question about joining two tables
Posted by Wes McKinney <we...@gmail.com>.
This is a new document that we just started earlier this week. I'd put
together some docs in the past to try to bootstrap community
organization on this, but since we're now finally putting hands to
code after setting up some critical dependencies (like the Datasets
interface, which is needed to implement scans, and the array
function/kernels framework), the documents + supporting Jira issues
will be more specifically about an implementation plan. We'd welcome
participation from anyone who is interested in this critical project.
On Thu, Mar 11, 2021 at 1:55 PM Aldrin <ak...@ucsc.edu.invalid> wrote:
>
> Hi Ben, thanks for the link!
>
> I will eventually be interested in this direction as well, but hadn't seen
> this document. Is there a place where these design documents can be found?
> I've seen this and a few other google doc links floating around the mailing
> list but I can't figure out how to navigate to a google drive or a page
> enumerating the various documents.
>
> Thank you!
>
> Aldrin Montana
> Computer Science PhD Student
> UC Santa Cruz
>
>
> On Thu, Mar 11, 2021 at 10:07 AM Benjamin Kietzman <be...@gmail.com>
> wrote:
>
> > Hi,
> >
> > This is not yet implemented but it is on the roadmap for the near future:
> >
> > https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
> >
> > Ben Kietzman
> >
> > On Thu, Mar 11, 2021 at 12:33 PM Kirill Lykov <ly...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > Is it possible somehow using existing compute functionality or some other
> > > code to join two tables by values in a common column?
> > >
> > > --
> > > Best regards,
> > > Kirill Lykov
> > >
> >
Re: Question about joining two tables
Posted by Aldrin <ak...@ucsc.edu.INVALID>.
Hi Ben, thanks for the link!
I will eventually be interested in this direction as well, but hadn't seen
this document. Is there a place where these design documents can be found?
I've seen this and a few other google doc links floating around the mailing
list but I can't figure out how to navigate to a google drive or a page
enumerating the various documents.
Thank you!
Aldrin Montana
Computer Science PhD Student
UC Santa Cruz
On Thu, Mar 11, 2021 at 10:07 AM Benjamin Kietzman <be...@gmail.com>
wrote:
> Hi,
>
> This is not yet implemented but it is on the roadmap for the near future:
>
> https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
>
> Ben Kietzman
>
> On Thu, Mar 11, 2021 at 12:33 PM Kirill Lykov <ly...@gmail.com>
> wrote:
>
> > Hi,
> >
> > Is it possible somehow using existing compute functionality or some other
> > code to join two tables by values in a common column?
> >
> > --
> > Best regards,
> > Kirill Lykov
> >
>
Re: Question about joining two tables
Posted by Benjamin Kietzman <be...@gmail.com>.
Hi,
This is not yet implemented but it is on the roadmap for the near future:
https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
Ben Kietzman
On Thu, Mar 11, 2021 at 12:33 PM Kirill Lykov <ly...@gmail.com>
wrote:
> Hi,
>
> Is it possible somehow using existing compute functionality or some other
> code to join two tables by values in a common column?
>
> --
> Best regards,
> Kirill Lykov
>