[jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167447#comment-15167447 ] 

Rohini Palaniswamy commented on TEZ-3140:
-----------------------------------------

It would have been easy if we can do bb.array(), but because it is a read only ByteBuffer could do nothing about it. Started with changing UserPayLoad to return payload.duplicate() instead of payload.asReadOnlyBuffer(), but that did not work as the payload was already read only.  UserPayLoad ByteBuffer is constructed from ByteString.asReadOnlyByteBuffer() and there is no way to get around that as ByteString does not expose the underlying array at all. 

> Reduce AM memory usage while serialization
> ------------------------------------------
>
>                 Key: TEZ-3140
>                 URL: https://issues.apache.org/jira/browse/TEZ-3140
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.7.1, 0.8.3
>
>         Attachments: TEZ-3140-1.patch
>
>
>    There is an unnecessary copy of userpayload byte array during serialization.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)