You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2015/07/17 08:34:04 UTC

[jira] [Created] (YARN-3935) Support compression for RM HA ApplicationStateData

Ming Ma created YARN-3935:
-----------------------------

             Summary: Support compression for RM HA ApplicationStateData
                 Key: YARN-3935
                 URL: https://issues.apache.org/jira/browse/YARN-3935
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Ming Ma


If we use ZK as the RM HA, it is possible for some application state to exceed the max object size imposed by ZK service. We can apply compression before storing the data to ZK.

We might want to add the compression functionality at RMStateStore layer so that different store implementations can use it.

The design might also want to take care of compatibility issue. After compression is enabled and RM restarts; the older state store should still be loaded properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)