You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Payne (JIRA)" <ji...@apache.org> on 2016/06/09 16:35:21 UTC

[jira] [Updated] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

     [ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Payne updated YARN-5008:
-----------------------------
    Affects Version/s:     (was: 2.7.0)
                       2.7.3

Changing Fix Version to 2.7.3 since branch 2.7.3 has not yet been created.

> LeveldbRMStateStore database can grow substantially leading to long recovery times
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-5008
>                 URL: https://issues.apache.org/jira/browse/YARN-5008
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.7.3
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>             Fix For: 2.7.4
>
>         Attachments: YARN-5008.001.patch
>
>
> On large clusters with high application churn the background compaction in leveldb may not be able to keep up with the write rate.  This can lead to large leveldb databases that take many minutes to recover despite not having very much real data in the database to load.  Most the time is spent traversing tables full of keys that have been deleted.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org