You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by "Benamor, Adel" <ad...@cgi.com> on 2016/07/05 14:59:00 UTC

Help with the Optimizer of Apache Drill

Hello,
I'm new in the utilization of data virtualization and I try  to understand the running of Apache Drill.
I browsed the documentation but I didn't understand how is the running of the optimizer.
Indeed, I learned that it's a cost-base optimizer, but nothing else.
I want to know how the optimizer works ?

Thanks for your help
Warm regards
Adel BENAMOR


Re: Help with the Optimizer of Apache Drill

Posted by Abhishek Girish <ab...@gmail.com>.
Adding to Rahul,

You can also take a look at Calcite [2], (which Drill uses for SQL parsing
+ query optimization) and a relevant thread I found on the mailing list
[3].

[2] https://calcite.apache.org/
[3]
http://mail-archives.apache.org/mod_mbox/drill-dev/201506.mbox/%3CCAFyDVvLKkmiZeUcFyFYXYgE_5KzVopdS0ozyaBub54NCL7KL6w@mail.gmail.com%3E

On Tue, Jul 5, 2016 at 10:39 AM, rahul challapalli <
challapallirahul@gmail.com> wrote:

> For a start, below is the relevant piece from the documentation [1]. You
> can also prepend any query with "explain plan for" to view the exact plan
> generated by Drill's Optimizer.
>
> • Optimizer: Drill uses various standard database optimizations such as
> rule based/cost based, as well as data locality and other optimization
> rules exposed by the storage engine to re-write and split the query. The
> output of the optimizer is a distributed physical query plan that
> represents the most efficient and fastest way to execute the query across
> different nodes in the cluster.
>
> [1] https://drill.apache.org/architecture/
>
> On Tue, Jul 5, 2016 at 7:59 AM, Benamor, Adel <ad...@cgi.com>
> wrote:
>
> > Hello,
> > I'm new in the utilization of data virtualization and I try  to
> understand
> > the running of Apache Drill.
> > I browsed the documentation but I didn't understand how is the running of
> > the optimizer.
> > Indeed, I learned that it's a cost-base optimizer, but nothing else.
> > I want to know how the optimizer works ?
> >
> > Thanks for your help
> > Warm regards
> > Adel BENAMOR
> >
> >
>

Re: Help with the Optimizer of Apache Drill

Posted by rahul challapalli <ch...@gmail.com>.
For a start, below is the relevant piece from the documentation [1]. You
can also prepend any query with "explain plan for" to view the exact plan
generated by Drill's Optimizer.

• Optimizer: Drill uses various standard database optimizations such as
rule based/cost based, as well as data locality and other optimization
rules exposed by the storage engine to re-write and split the query. The
output of the optimizer is a distributed physical query plan that
represents the most efficient and fastest way to execute the query across
different nodes in the cluster.

[1] https://drill.apache.org/architecture/

On Tue, Jul 5, 2016 at 7:59 AM, Benamor, Adel <ad...@cgi.com> wrote:

> Hello,
> I'm new in the utilization of data virtualization and I try  to understand
> the running of Apache Drill.
> I browsed the documentation but I didn't understand how is the running of
> the optimizer.
> Indeed, I learned that it's a cost-base optimizer, but nothing else.
> I want to know how the optimizer works ?
>
> Thanks for your help
> Warm regards
> Adel BENAMOR
>
>