You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Henry Robinson <he...@apache.org> on 2017/07/10 17:25:28 UTC
Re: Add total number of started threads to /threadz
This seems valuable to me.
On 28 June 2017 at 21:26, Lars Volker <lv...@cloudera.com> wrote:
> Hi All,
>
> While investigating IMPALA-5598 I added a counter with the total number of
> threads to /threadz. See below for what it looks like (I hope the ASF
> mailer won't eat the format). Does this look helpful? If someone thinks it
> does, I'll create a JIRA and push the change.
>
> Thanks, Lars
>
>
> Thread GroupsAll threads
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?all>DataStreamSender
> : (running: 0, total created: 2500)
> <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=DataStreamSender>common
> : (running: 2, total created: 2)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=common>
> coordinator-fragment-rpc
> : (running: 12, total created: 12)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=coordinator-
> fragment-rpc>disk-io-mgr
> : (running: 34, total created: 34)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=disk-io-mgr>
> fragment-mgr
> : (running: 0, total created: 2550)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=fragment-mgr
> >hdfs-scan-node
> : (running: 0, total created: 2500)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=hdfs-scan-node
> >hdfs-worker-pool
> : (running: 16, total created: 16)
> <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=hdfs-worker-pool>impala-server
> : (running: 8, total created: 8)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=impala-server>
> plan-fragment-executor
> : (running: 0, total created: 2550)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=plan-fragment-
> executor>query-exec-state
> : (running: 0, total created: 50)
> <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=query-exec-state>rpc-pool
> : (running: 8, total created: 8)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=rpc-pool>
> scheduling
> : (running: 1, total created: 1)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=scheduling
> >setup-server
> : (running: 2, total created: 2)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=setup-server>
> statestore-subscriber
> : (running: 1, total created: 1)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=statestore-
> subscriber>thrift-server
> : (running: 248, total created: 248)
> <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=thrift-server>
>
Re: Add total number of started threads to /threadz
Posted by Lars Volker <lv...@cloudera.com>.
Thank you for the feedback. I opened IMPALA-5643 to track this and pushed a
change here: https://gerrit.cloudera.org/#/c/7390/
On Mon, Jul 10, 2017 at 10:25 AM, Henry Robinson <he...@apache.org> wrote:
> This seems valuable to me.
>
> On 28 June 2017 at 21:26, Lars Volker <lv...@cloudera.com> wrote:
>
> > Hi All,
> >
> > While investigating IMPALA-5598 I added a counter with the total number
> of
> > threads to /threadz. See below for what it looks like (I hope the ASF
> > mailer won't eat the format). Does this look helpful? If someone thinks
> it
> > does, I'll create a JIRA and push the change.
> >
> > Thanks, Lars
> >
> >
> > Thread GroupsAll threads
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?all
> >DataStreamSender
> > : (running: 0, total created: 2500)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> > group?group=DataStreamSender>common
> > : (running: 2, total created: 2)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=common>
> > coordinator-fragment-rpc
> > : (running: 12, total created: 12)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=coordinator-
> > fragment-rpc>disk-io-mgr
> > : (running: 34, total created: 34)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=disk-io-mgr>
> > fragment-mgr
> > : (running: 0, total created: 2550)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=fragment-mgr
> > >hdfs-scan-node
> > : (running: 0, total created: 2500)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=hdfs-scan-node
> > >hdfs-worker-pool
> > : (running: 16, total created: 16)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> > group?group=hdfs-worker-pool>impala-server
> > : (running: 8, total created: 8)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=impala-server>
> > plan-fragment-executor
> > : (running: 0, total created: 2550)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=plan-fragment-
> > executor>query-exec-state
> > : (running: 0, total created: 50)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> > group?group=query-exec-state>rpc-pool
> > : (running: 8, total created: 8)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=rpc-pool>
> > scheduling
> > : (running: 1, total created: 1)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=scheduling
> > >setup-server
> > : (running: 2, total created: 2)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=setup-server
> >
> > statestore-subscriber
> > : (running: 1, total created: 1)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-group?group=statestore-
> > subscriber>thrift-server
> > : (running: 248, total created: 248)
> > <http://lv-desktop.ca.cloudera.com:25000/thread-
> group?group=thrift-server>
> >
>