You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Zhijie Shen (JIRA)" <ji...@apache.org> on 2014/11/10 09:18:33 UTC

[jira] [Updated] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

     [ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhijie Shen updated YARN-2837:
------------------------------
    Attachment: YARN-2834.1.patch

Create a patch to make the timeline state store, I choose to use Leveldb impl because:

1. Timeline server already uses leveldb.
2. It provides atomic operations, and isolate the system dependent FS.
3. Less heavy and complex than using HDFS (in particular in secure mode)
4. Easy to implement the operations. 

> Timeline server needs to recover the timeline DT when restarting
> ----------------------------------------------------------------
>
>                 Key: YARN-2837
>                 URL: https://issues.apache.org/jira/browse/YARN-2837
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: timelineserver
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>            Priority: Blocker
>         Attachments: YARN-2834.1.patch
>
>
> Timeline server needs to recover the stateful information when restarting as RM/NM/JHS does now. So far the stateful information only includes the timeline DT. Without recovery, the timeline DT of the existing YARN apps is not long valid, and cannot be renewed any more after the timeline server is restarted.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)