You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2019/02/26 00:42:01 UTC
[jira] [Resolved] (SPARK-26674) Consolidate CompositeByteBuf when
reading large frame
[ https://issues.apache.org/jira/browse/SPARK-26674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marcelo Vanzin resolved SPARK-26674.
------------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23602
[https://github.com/apache/spark/pull/23602]
> Consolidate CompositeByteBuf when reading large frame
> -----------------------------------------------------
>
> Key: SPARK-26674
> URL: https://issues.apache.org/jira/browse/SPARK-26674
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.4.0
> Reporter: liupengcheng
> Assignee: liupengcheng
> Priority: Major
> Fix For: 3.0.0
>
>
> Currently, TransportFrameDecoder will not consolidate the buffers read from network which may cause memory waste. Actually, bytebuf's writtenIndex is far less than it's capacity in most cases, so we can optimize it by doing consolidation.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org