query plan caching?

[Vince Gonzalez <vi...@gmail.com>]

Does Drill do any caching of query plans?

Re: query plan caching?

[Neeraja Rentachintala <nr...@maprtech.com>]

Query plan caching is typically very useful if you have reporting type of
queries  where the query patterns are fixed and vary mostly on filter
conditions. For adhoc queries or data exploration use cases where there may
not be fixed query patterns, this technique is not frequently useful.

Similar to what Andries mentioned, what is the issue you are seeing. The
team might have ideas to help specifically.

-Neeraja

On Thu, Jan 14, 2016 at 7:34 AM, Andries Engelbrecht <
aengelbrecht@maprtech.com> wrote:

> Most of the effort have been going into metadata caching and improvements
> in this area, specifically DFS parquet and Hive. And also improved
> directory pruning at planning time. This helps to reduce he planning time
> significantly. These seem to have been the big time consumers for query
> plans
>
> I have not seen any specific effort to cache query plans. However Drill is
> used for analytical purposes the query volumes are substantially lower than
> transactional RDBMS where query plan caching can be critical.
>
> Are you potentially seeing an issue with query volume or query planning
> time?
>
> --Andries
>
> > On Jan 14, 2016, at 7:21 AM, Jason Altekruse <al...@gmail.com>
> wrote:
> >
> > Currently not to my knowledge. Are there queries you are seeing that are
> > taking an abnormally long time to plan?
> >
> > On Thu, Jan 14, 2016 at 6:25 AM, Vince Gonzalez <
> vince.gonzalez@gmail.com>
> > wrote:
> >
> >> Does Drill do any caching of query plans?
> >>
>
>

Re: query plan caching?

[Andries Engelbrecht <ae...@maprtech.com>]

Most of the effort have been going into metadata caching and improvements in this area, specifically DFS parquet and Hive. And also improved directory pruning at planning time. This helps to reduce he planning time significantly. These seem to have been the big time consumers for query plans

I have not seen any specific effort to cache query plans. However Drill is used for analytical purposes the query volumes are substantially lower than transactional RDBMS where query plan caching can be critical.

Are you potentially seeing an issue with query volume or query planning time?

--Andries

> On Jan 14, 2016, at 7:21 AM, Jason Altekruse <al...@gmail.com> wrote:
> 
> Currently not to my knowledge. Are there queries you are seeing that are
> taking an abnormally long time to plan?
> 
> On Thu, Jan 14, 2016 at 6:25 AM, Vince Gonzalez <vi...@gmail.com>
> wrote:
> 
>> Does Drill do any caching of query plans?
>> 

Re: query plan caching?

[Jason Altekruse <al...@gmail.com>]

Currently not to my knowledge. Are there queries you are seeing that are
taking an abnormally long time to plan?

On Thu, Jan 14, 2016 at 6:25 AM, Vince Gonzalez <vi...@gmail.com>
wrote:

> Does Drill do any caching of query plans?
>