You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Zhijie Shen (JIRA)" <ji...@apache.org> on 2015/02/27 18:53:05 UTC
[jira] [Commented] (YARN-3167) [Aggregator implementation]
Implement the core functionality of the base aggregator service
[ https://issues.apache.org/jira/browse/YARN-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340448#comment-14340448 ]
Zhijie Shen commented on YARN-3167:
-----------------------------------
Hi Vrushali, FYI, we have an integration test inside TestDistributedShell (search for v2). Once you have the POC backend impl and wire aggregator to it, you can use this test case to verify the POC prototye work properly. So far we have seen that distributed shell app can write new timeline entity to the per node aggregator, and it has been routed the right per app aggregator. You may start from there.
> [Aggregator implementation] Implement the core functionality of the base aggregator service
> -------------------------------------------------------------------------------------------
>
> Key: YARN-3167
> URL: https://issues.apache.org/jira/browse/YARN-3167
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
> Reporter: Sangjin Lee
> Assignee: Vrushali C
> Attachments: RM-AM-NM-Aggregator.png, Sequence_diagram_User_RM_AM_NM_Aggregator_Writer.png
>
>
> The basic skeleton of the timeline aggregator has been set up by YARN-3030. We need to implement the core functionality of the base aggregator service. The key things include
> - handling the requests from clients (sync or async)
> - buffering data
> - handling the aggregation logic
> - invoking the storage API
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)