You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Sangjin Lee (JIRA)" <ji...@apache.org> on 2015/07/21 22:24:04 UTC

[jira] [Created] (YARN-3949) ensure timely flush of timeline writes

Sangjin Lee created YARN-3949:
---------------------------------

             Summary: ensure timely flush of timeline writes
                 Key: YARN-3949
                 URL: https://issues.apache.org/jira/browse/YARN-3949
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: timelineserver
    Affects Versions: YARN-2928
            Reporter: Sangjin Lee
            Assignee: Sangjin Lee


Currently flushing of timeline writes is not really handled. For example, {{HBaseTimelineWriterImpl}} relies on HBase's {{BufferedMutator}} to batch and write puts asynchronously. However, {{BufferedMutator}} may not flush them to HBase unless the internal buffer fills up.

We do need a flush functionality first to ensure that data are written in a reasonably timely manner, and to be able to ensure some critical writes are done synchronously (e.g. key lifecycle events).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)