You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Yi Liu (JIRA)" <ji...@apache.org> on 2014/11/26 04:49:12 UTC

[jira] [Created] (HADOOP-11339) Reuse buffer for Hadoop RPC

Yi Liu created HADOOP-11339:
-------------------------------

             Summary: Reuse buffer for Hadoop RPC
                 Key: HADOOP-11339
                 URL: https://issues.apache.org/jira/browse/HADOOP-11339
             Project: Hadoop Common
          Issue Type: Improvement
          Components: ipc, performance
            Reporter: Yi Liu
            Assignee: Yi Liu


For Hadoop RPCs, we will try to reuse the available connections.
But when we process each rpc in the same connection, we will allocate a fresh heap byte buffer to store the rpc bytes data. The rpc message may be very large, i.e., datanode blocks report. 

There is chance to cause full gc as discussed in HDFS-7435



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)