You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Divya (Jira)" <ji...@apache.org> on 2021/05/12 15:46:00 UTC

[jira] [Commented] (TEZ-3820) Plugin to write history events to ATSv2

    [ https://issues.apache.org/jira/browse/TEZ-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343316#comment-17343316 ] 

Divya commented on TEZ-3820:
----------------------------

Thanks [~rohithsharma] for this. We are trying to use Tez with ATSv2 as well and applied this patch now.  As [~prabhujoseph] mentioned we do get null pointer exception because we do not have call back handler at this point.  Tried creating Callback handler before this but DAG is not running/publishing entities. Can i know if we made any further changes on this.

 
// assumption is at this point AMRMClient is created! So callback handler is set to null   TezAMRMClientAsyncProvider.createAMRMClientAsync(1000, null)

> Plugin to write history events to ATSv2
> ---------------------------------------
>
>                 Key: TEZ-3820
>                 URL: https://issues.apache.org/jira/browse/TEZ-3820
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>            Priority: Major
>         Attachments: TEZ-3884.001.patch
>
>
> YARN Timeline Service v.2 is the next major iteration of Timeline Server, following v.1 and v.1.5. ATSV.2 is created to address two major challenges of v.1 i.e Scalability and Usability improvements. Refer [ATSv2-doc|https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html#Timeline_Service_v.2_REST_API]
> It would be nice to use ATSv2 for Tez which solves scalability problems. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)