You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2015/10/12 16:56:05 UTC

[jira] [Updated] (TEZ-2628) History logging plugin to write ATS events to HDFS

     [ https://issues.apache.org/jira/browse/TEZ-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe updated TEZ-2628:
----------------------------
    Attachment: TEZ-2628.004.patch

Minor update to the patch to fix a bug that [~jeagles] pointed out offline.  TEZ_APPLICATION entity types were not being logged because isValidEvent was rejecting any entity without a dagID, and those can be posted without dag IDs.


> History logging plugin to write ATS events to HDFS
> --------------------------------------------------
>
>                 Key: TEZ-2628
>                 URL: https://issues.apache.org/jira/browse/TEZ-2628
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: TEZ-2628.001.patch, TEZ-2628.002.patch, TEZ-2628.003.patch, TEZ-2628.004.patch, hive-timeline.json
>
>
> This provides another history logging alternative that conceptually the same as the timeline logging service but logs the entities to a file rather than posting the events to the timeline server directly.  When coupled with the timeline store plugin from YARN-3942 it allows the Tez job to be decoupled from the timeline server yet the Tez UI can still function properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)