You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by mufy <mu...@gmail.com> on 2015/01/16 15:48:20 UTC
Drill Specific Performance Monitoring Utilities
Are there any Drill specific custom tools to monitor performance and
statistics during a query execution?
---
Mufeed Usman
My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
<http://mufeed.livejournal.com>
Re: Drill Specific Performance Monitoring Utilities
Posted by Ted Dunning <te...@gmail.com>.
Moderately nice I would say.
It might be nice to see records per second or memory usage. Not sure how
those would be collected from per query diagnostics.
On Sat, Jan 17, 2015 at 7:28 AM, Jim Scott <js...@maprtech.com> wrote:
> How useful would it be if there was an OpenTSDB tcollector for drill
> queries?
>
> On Fri, Jan 16, 2015 at 7:53 PM, mufy <mu...@gmail.com> wrote:
>
> > Appreciate the feedback guys.
> >
> >
> > ---
> > Mufeed Usman
> > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> > Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> > <http://mufeed.livejournal.com>
> >
> >
> >
> >
> > On Sat, Jan 17, 2015 at 7:17 AM, Jacques Nadeau <ja...@apache.org>
> > wrote:
> >
> > > I actually have a patch I need to post that provides near real-time
> query
> > > profile updates so you can watch the query progress. I'll create a
> JIRA
> > > and get it posted soon.
> > >
> > > On Fri, Jan 16, 2015 at 1:14 PM, Jason Altekruse <
> > altekrusejason@gmail.com
> > > >
> > > wrote:
> > >
> > > > We do not currently have information gathered during execution. There
> > > was a
> > > > discussion at some point about gathering and exposing information
> that
> > is
> > > > usually reported at the end of they query in the Web UI query profile
> > > view
> > > > during execution and updating that interface to track progress. I'm
> not
> > > > sure how far that discussion went or if anyone is currently working
> on
> > > it.
> > > >
> > > > -Jason
> > > >
> > > > On Fri, Jan 16, 2015 at 6:48 AM, mufy <mu...@gmail.com>
> wrote:
> > > >
> > > > > Are there any Drill specific custom tools to monitor performance
> and
> > > > > statistics during a query execution?
> > > > >
> > > > > ---
> > > > > Mufeed Usman
> > > > > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400>
> |
> > My
> > > > > Social Cause <http://www.vision2016.org.in/> | My Blogs :
> > LiveJournal
> > > > > <http://mufeed.livejournal.com>
> > > > >
> > > >
> > >
> >
>
>
>
> --
> *Jim Scott*
> Director, Enterprise Strategy & Architecture
> +1 (347) 746-9281
>
> <http://www.mapr.com/>
> [image: MapR Technologies] <http://www.mapr.com>
>
Re: Drill Specific Performance Monitoring Utilities
Posted by Jim Scott <js...@maprtech.com>.
How useful would it be if there was an OpenTSDB tcollector for drill
queries?
On Fri, Jan 16, 2015 at 7:53 PM, mufy <mu...@gmail.com> wrote:
> Appreciate the feedback guys.
>
>
> ---
> Mufeed Usman
> My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> <http://mufeed.livejournal.com>
>
>
>
>
> On Sat, Jan 17, 2015 at 7:17 AM, Jacques Nadeau <ja...@apache.org>
> wrote:
>
> > I actually have a patch I need to post that provides near real-time query
> > profile updates so you can watch the query progress. I'll create a JIRA
> > and get it posted soon.
> >
> > On Fri, Jan 16, 2015 at 1:14 PM, Jason Altekruse <
> altekrusejason@gmail.com
> > >
> > wrote:
> >
> > > We do not currently have information gathered during execution. There
> > was a
> > > discussion at some point about gathering and exposing information that
> is
> > > usually reported at the end of they query in the Web UI query profile
> > view
> > > during execution and updating that interface to track progress. I'm not
> > > sure how far that discussion went or if anyone is currently working on
> > it.
> > >
> > > -Jason
> > >
> > > On Fri, Jan 16, 2015 at 6:48 AM, mufy <mu...@gmail.com> wrote:
> > >
> > > > Are there any Drill specific custom tools to monitor performance and
> > > > statistics during a query execution?
> > > >
> > > > ---
> > > > Mufeed Usman
> > > > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> |
> My
> > > > Social Cause <http://www.vision2016.org.in/> | My Blogs :
> LiveJournal
> > > > <http://mufeed.livejournal.com>
> > > >
> > >
> >
>
--
*Jim Scott*
Director, Enterprise Strategy & Architecture
+1 (347) 746-9281
<http://www.mapr.com/>
[image: MapR Technologies] <http://www.mapr.com>
Re: Drill Specific Performance Monitoring Utilities
Posted by mufy <mu...@gmail.com>.
Appreciate the feedback guys.
---
Mufeed Usman
My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
<http://mufeed.livejournal.com>
On Sat, Jan 17, 2015 at 7:17 AM, Jacques Nadeau <ja...@apache.org> wrote:
> I actually have a patch I need to post that provides near real-time query
> profile updates so you can watch the query progress. I'll create a JIRA
> and get it posted soon.
>
> On Fri, Jan 16, 2015 at 1:14 PM, Jason Altekruse <altekrusejason@gmail.com
> >
> wrote:
>
> > We do not currently have information gathered during execution. There
> was a
> > discussion at some point about gathering and exposing information that is
> > usually reported at the end of they query in the Web UI query profile
> view
> > during execution and updating that interface to track progress. I'm not
> > sure how far that discussion went or if anyone is currently working on
> it.
> >
> > -Jason
> >
> > On Fri, Jan 16, 2015 at 6:48 AM, mufy <mu...@gmail.com> wrote:
> >
> > > Are there any Drill specific custom tools to monitor performance and
> > > statistics during a query execution?
> > >
> > > ---
> > > Mufeed Usman
> > > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> > > Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> > > <http://mufeed.livejournal.com>
> > >
> >
>
Re: Drill Specific Performance Monitoring Utilities
Posted by Jacques Nadeau <ja...@apache.org>.
I actually have a patch I need to post that provides near real-time query
profile updates so you can watch the query progress. I'll create a JIRA
and get it posted soon.
On Fri, Jan 16, 2015 at 1:14 PM, Jason Altekruse <al...@gmail.com>
wrote:
> We do not currently have information gathered during execution. There was a
> discussion at some point about gathering and exposing information that is
> usually reported at the end of they query in the Web UI query profile view
> during execution and updating that interface to track progress. I'm not
> sure how far that discussion went or if anyone is currently working on it.
>
> -Jason
>
> On Fri, Jan 16, 2015 at 6:48 AM, mufy <mu...@gmail.com> wrote:
>
> > Are there any Drill specific custom tools to monitor performance and
> > statistics during a query execution?
> >
> > ---
> > Mufeed Usman
> > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> > Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> > <http://mufeed.livejournal.com>
> >
>
Re: Drill Specific Performance Monitoring Utilities
Posted by Ted Dunning <te...@gmail.com>.
I thought that the diagnostics were emitted as they were produced (recent
change).
But query by query performance monitoring would be a very cool thing. And
the swim-lane visualization that Jacques showed the other day was fabulous.
On Fri, Jan 16, 2015 at 1:14 PM, Jason Altekruse <al...@gmail.com>
wrote:
> We do not currently have information gathered during execution. There was a
> discussion at some point about gathering and exposing information that is
> usually reported at the end of they query in the Web UI query profile view
> during execution and updating that interface to track progress. I'm not
> sure how far that discussion went or if anyone is currently working on it.
>
> -Jason
>
> On Fri, Jan 16, 2015 at 6:48 AM, mufy <mu...@gmail.com> wrote:
>
> > Are there any Drill specific custom tools to monitor performance and
> > statistics during a query execution?
> >
> > ---
> > Mufeed Usman
> > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> > Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> > <http://mufeed.livejournal.com>
> >
>
Re: Drill Specific Performance Monitoring Utilities
Posted by Jason Altekruse <al...@gmail.com>.
We do not currently have information gathered during execution. There was a
discussion at some point about gathering and exposing information that is
usually reported at the end of they query in the Web UI query profile view
during execution and updating that interface to track progress. I'm not
sure how far that discussion went or if anyone is currently working on it.
-Jason
On Fri, Jan 16, 2015 at 6:48 AM, mufy <mu...@gmail.com> wrote:
> Are there any Drill specific custom tools to monitor performance and
> statistics during a query execution?
>
> ---
> Mufeed Usman
> My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> <http://mufeed.livejournal.com>
>