You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hawq.apache.org by "Hongxu Ma (JIRA)" <ji...@apache.org> on 2018/02/26 05:40:00 UTC
[jira] [Created] (HAWQ-1591) Common tuple batch structure for
vectorized execution
Hongxu Ma created HAWQ-1591:
-------------------------------
Summary: Common tuple batch structure for vectorized execution
Key: HAWQ-1591
URL: https://issues.apache.org/jira/browse/HAWQ-1591
Project: Apache HAWQ
Issue Type: Sub-task
Components: Query Execution
Reporter: Hongxu Ma
Assignee: Lei Chang
Fix For: backlog
A common tuple batch structure for vectorized execution, holds the tuples which be transfered between vectorized operators.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Re: [jira] [Created] (HAWQ-1591) Common tuple batch structure for
vectorized execution
Posted by Hongxu Ma <in...@outlook.com>.
Thank you very much! Lirong
在 27/02/2018 11:31, Ivan Weng 写道:
> Thanks Lirong. It's a good suggestion. Will evaluate the benefit and cost
> before making decision.
>
> Also I think it's better to make the tuple batch interfaces more general
> and its internal format could be replaced if possible.
>
>
> Regards,
> Ivan
>
> On Mon, Feb 26, 2018 at 6:59 PM, Lirong Jian <ji...@gmail.com> wrote:
>
>> Have you guy consider using Apache Arrow format (http://arrow.apache.org/)
>> as the in-memory tuple batch structure for vectorized execution? I think
>> the goal of Apache Arrow project matches the one of vectorized execution
>> perfectly, and its community is quite active, although the implementation
>> of Apache Arrow format is far away from the implementation of
>> PostgreSQL/GPDB/HAWQ tuple structure , which means the engineering efforts
>> needed would be huge.
>>
>> Just my two cents.
>>
>> Lirong
>>
>> Lirong Jian
>> HashData Inc.
>>
>> 2018-02-26 13:40 GMT+08:00 Hongxu Ma (JIRA) <ji...@apache.org>:
>>
>>> Hongxu Ma created HAWQ-1591:
>>> -------------------------------
>>>
>>> Summary: Common tuple batch structure for vectorized
>> execution
>>> Key: HAWQ-1591
>>> URL: https://issues.apache.org/jira/browse/HAWQ-1591
>>> Project: Apache HAWQ
>>> Issue Type: Sub-task
>>> Components: Query Execution
>>> Reporter: Hongxu Ma
>>> Assignee: Lei Chang
>>> Fix For: backlog
>>>
>>>
>>> A common tuple batch structure for vectorized execution, holds the tuples
>>> which be transfered between vectorized operators.
>>>
>>>
>>>
>>>
>>>
>>> --
>>> This message was sent by Atlassian JIRA
>>> (v7.6.3#76005)
>>>
--
Regards,
Hongxu.
Re: [jira] [Created] (HAWQ-1591) Common tuple batch structure for
vectorized execution
Posted by Ivan Weng <iw...@pivotal.io>.
Thanks Lirong. It's a good suggestion. Will evaluate the benefit and cost
before making decision.
Also I think it's better to make the tuple batch interfaces more general
and its internal format could be replaced if possible.
Regards,
Ivan
On Mon, Feb 26, 2018 at 6:59 PM, Lirong Jian <ji...@gmail.com> wrote:
> Have you guy consider using Apache Arrow format (http://arrow.apache.org/)
> as the in-memory tuple batch structure for vectorized execution? I think
> the goal of Apache Arrow project matches the one of vectorized execution
> perfectly, and its community is quite active, although the implementation
> of Apache Arrow format is far away from the implementation of
> PostgreSQL/GPDB/HAWQ tuple structure , which means the engineering efforts
> needed would be huge.
>
> Just my two cents.
>
> Lirong
>
> Lirong Jian
> HashData Inc.
>
> 2018-02-26 13:40 GMT+08:00 Hongxu Ma (JIRA) <ji...@apache.org>:
>
> > Hongxu Ma created HAWQ-1591:
> > -------------------------------
> >
> > Summary: Common tuple batch structure for vectorized
> execution
> > Key: HAWQ-1591
> > URL: https://issues.apache.org/jira/browse/HAWQ-1591
> > Project: Apache HAWQ
> > Issue Type: Sub-task
> > Components: Query Execution
> > Reporter: Hongxu Ma
> > Assignee: Lei Chang
> > Fix For: backlog
> >
> >
> > A common tuple batch structure for vectorized execution, holds the tuples
> > which be transfered between vectorized operators.
> >
> >
> >
> >
> >
> > --
> > This message was sent by Atlassian JIRA
> > (v7.6.3#76005)
> >
>
Re: [jira] [Created] (HAWQ-1591) Common tuple batch structure for
vectorized execution
Posted by Lirong Jian <ji...@gmail.com>.
Have you guy consider using Apache Arrow format (http://arrow.apache.org/)
as the in-memory tuple batch structure for vectorized execution? I think
the goal of Apache Arrow project matches the one of vectorized execution
perfectly, and its community is quite active, although the implementation
of Apache Arrow format is far away from the implementation of
PostgreSQL/GPDB/HAWQ tuple structure , which means the engineering efforts
needed would be huge.
Just my two cents.
Lirong
Lirong Jian
HashData Inc.
2018-02-26 13:40 GMT+08:00 Hongxu Ma (JIRA) <ji...@apache.org>:
> Hongxu Ma created HAWQ-1591:
> -------------------------------
>
> Summary: Common tuple batch structure for vectorized execution
> Key: HAWQ-1591
> URL: https://issues.apache.org/jira/browse/HAWQ-1591
> Project: Apache HAWQ
> Issue Type: Sub-task
> Components: Query Execution
> Reporter: Hongxu Ma
> Assignee: Lei Chang
> Fix For: backlog
>
>
> A common tuple batch structure for vectorized execution, holds the tuples
> which be transfered between vectorized operators.
>
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v7.6.3#76005)
>