You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@calcite.apache.org by Ameya Ladewar <am...@gmail.com> on 2018/04/12 00:20:06 UTC

[newbie]Help needed wrt execute a query in parallel

Hi All,

I am new to calcite. I need help to implement an "Exchange operator" in
calcite.

I read the Research Paper " Apache Calcite:A Foundational Framework for
Optimized Query Processing Over Heterogeneous Data Sources " for a mere
understanding of calcite.

An Exchange operator basically divides a query into plan fragments which
are executed parallelly.

 I got an minimal estimation of how a query optimizer works in calcite with
the help of adapters.

I need help to understand how a Query is executed in calcite and If
possible can I get a basic implementation idea.

 Can some body point me to Hello world of Exchange operator.

Thanks and Regards,
Amey Ladewar.

Re: [newbie]Help needed wrt execute a query in parallel

Posted by Michael Mior <mm...@uwaterloo.ca>.

If you haven't read it already, I would suggest you start by reading the
Volcano paper (
https://paperhub.s3.amazonaws.com/dace52a42c07f7f8348b08dc2b186061.pdf). It
gives a good overview of the exchange operator. Adding the exchange
operator is probably best done as an optional additional step after the
current optimization process. Note that Calcite currently has no facility
for parallel query execution.

--
Michael Mior
mmior@apache.org

2018-04-11 20:20 GMT-04:00 Ameya Ladewar <am...@gmail.com>:

> Hi All,
>
> I am new to calcite. I need help to implement an "Exchange operator" in
> calcite.
>
> I read the Research Paper " Apache Calcite:A Foundational Framework for
> Optimized Query Processing Over Heterogeneous Data Sources " for a mere
> understanding of calcite.
>
> An Exchange operator basically divides a query into plan fragments which
> are executed parallelly.
>
>  I got an minimal estimation of how a query optimizer works in calcite with
> the help of adapters.
>
> I need help to understand how a Query is executed in calcite and If
> possible can I get a basic implementation idea.
>
>  Can some body point me to Hello world of Exchange operator.
>
> Thanks and Regards,
> Amey Ladewar.
>