You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Bikas Saha (JIRA)" <ji...@apache.org> on 2014/06/14 04:43:01 UTC
[jira] [Commented] (TEZ-1119) Support display of user payloads in
Tez UI
[ https://issues.apache.org/jira/browse/TEZ-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031420#comment-14031420 ]
Bikas Saha commented on TEZ-1119:
---------------------------------
Can this data be generated by the user and passed to the AM along with the DAG definition and then the AM can write it out to history. From what I see the user just wants per vertex payload to be written to history so that it can be accessed from the UI. They can generate per entity payload-string and attach it to the entity in question (by adding a method to the TezEntityDescriptor). The AM simply writes this out when it receives the DAG. The users who need this can use it and the rest of the world does not need to be bothered about it.
On the patch itself, assuming that taskId-0 attemptId-0 will always make its way to a real task is always not valid. Task may be preempted before it can be launched for real.
> Support display of user payloads in Tez UI
> ------------------------------------------
>
> Key: TEZ-1119
> URL: https://issues.apache.org/jira/browse/TEZ-1119
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Hitesh Shah
> Assignee: Hitesh Shah
> Attachments: TEZ-1119.wip.patch
>
>
> Applications like Pig rely heavily on configurations bundled in as part of the user payload for debugging. This requires each Input/Output/Processor's user payload to be converted into something that easily consumable by the UI layer to be displayed back to the user as meaningful data.
--
This message was sent by Atlassian JIRA
(v6.2#6252)