You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@tez.apache.org by Fara Nasiri <Fa...@microsoft.com> on 2018/06/13 19:31:06 UTC

FW: monitoring Tez Counters/Metrics

From: Fara Nasiri
Sent: Wednesday, June 13, 2018 12:28 PM
To: user-subscribe@tez.apache.org
Subject: FW: monitoring Tez Counters/Metrics

Hi all

I'm following up on below question about Tez counters. I'm still wondering how we can monitor the counters on Tez since they won't show up in Mbeans? Any idea?

Thank you

From: Fara Nasiri
Sent: Monday, May 21, 2018 6:39 PM
To: user-subscribe@tez.apache.org<ma...@tez.apache.org>
Subject: monitoring Tez Counters/Metrics

Hello

I am trying to do some analysis using Tez counters on applications. I'm interested to see some of the metrics for vertex, Dag, Task and etc.
I'm using VisualVM to monitor all the application but I cannot see any of the counters on the dashboard (mbean). And I know Tez has counters, so is there any configuration to enable counters to show up on any monitoring tools? What would be the best way of monitoring performance using Tez Counters?

I appreciate any help in advance.

Re: FW: monitoring Tez Counters/Metrics

Posted by Kuhu Shukla <ks...@oath.com>.

Hi Fara,

Counters are available through a REST API. An example is :
https://
<server-name>:<portnum>/ws/v1/timeline/TEZ_DAG_ID/dag_1234_5678_910?_=<timestamp>

Hope this helps.

Kuhu

On Wed, Jun 13, 2018 at 2:31 PM, Fara Nasiri <Fa...@microsoft.com>
wrote:

>
>
> *From:* Fara Nasiri
> *Sent:* Wednesday, June 13, 2018 12:28 PM
> *To:* user-subscribe@tez.apache.org
> *Subject:* FW: monitoring Tez Counters/Metrics
>
>
>
> Hi all
>
>
>
> I’m following up on below question about Tez counters. I’m still wondering
> how we can monitor the counters on Tez since they won’t show up in Mbeans?
> Any idea?
>
>
>
> Thank you
>
>
>
> *From:* Fara Nasiri
> *Sent:* Monday, May 21, 2018 6:39 PM
> *To:* user-subscribe@tez.apache.org
> *Subject:* monitoring Tez Counters/Metrics
>
>
>
> Hello
>
>
>
> I am trying to do some analysis using Tez counters on applications. I’m
> interested to see some of the metrics for vertex, Dag, Task and etc.
>
> I’m using VisualVM to monitor all the application but I cannot see any of
> the counters on the dashboard (mbean). And I know Tez has counters, so is
> there any configuration to enable counters to show up on any monitoring
> tools? What would be the best way of monitoring performance using Tez
> Counters?
>
>
>
> I appreciate any help in advance.
>
>
>
>
>