You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Sangjin Lee (JIRA)" <ji...@apache.org> on 2015/04/24 02:28:39 UTC

[jira] [Updated] (YARN-3438) add a mode to replay MR job history files to the timeline service

     [ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sangjin Lee updated YARN-3438:
------------------------------
    Attachment: YARN-3438.000.patch

A preliminary patch based on MAPREDUCE-6355.005.patch to solicit reviews.

The idea is to scan an hdfs directory of jobhistory files, and each mapper will get a roughly equal share of job history files to process.

Also found a small issue in FileSystemTimelineWriterImpl.java and fixed it (cc [~vrushalic]).

Your feedback is greatly appreciated.

> add a mode to replay MR job history files to the timeline service
> -----------------------------------------------------------------
>
>                 Key: YARN-3438
>                 URL: https://issues.apache.org/jira/browse/YARN-3438
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Sangjin Lee
>            Assignee: Sangjin Lee
>         Attachments: YARN-3438.000.patch
>
>
> The subtask covers the work on top of YARN-3437 to add a mode to replay MR job history files to the timeline service storage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)