You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "liupengcheng (JIRA)" <ji...@apache.org> on 2019/01/21 11:34:00 UTC

[jira] [Created] (SPARK-26674) Consolidate CompositeByteBuf when reading large frame

liupengcheng created SPARK-26674:
------------------------------------

             Summary: Consolidate CompositeByteBuf when reading large frame
                 Key: SPARK-26674
                 URL: https://issues.apache.org/jira/browse/SPARK-26674
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.4.0
            Reporter: liupengcheng


Currently, TransportFrameDecoder will not consolidate the buffers read from network which may cause memory waste. Actually, bytebuf's writtenIndex is far less than it's capacity  in most cases, so we can optimize it by doing consolidation.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org