You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2013/11/06 04:25:19 UTC

[jira] [Created] (TEZ-596) Change MRHelpers.serializeConf* methods to use Protobuf for serialization

Siddharth Seth created TEZ-596:
----------------------------------

             Summary: Change MRHelpers.serializeConf* methods to use Protobuf for serialization
                 Key: TEZ-596
                 URL: https://issues.apache.org/jira/browse/TEZ-596
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Siddharth Seth


Using Configuration.write 1) takes a longer time, 2) Generates much larger byte arrays - typically 2x of what is generated by protobuf. After compression, both are roughly the same size - but compressing the smaller protobuf array is also faster.



--
This message was sent by Atlassian JIRA
(v6.1#6144)