You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2014/07/25 10:03:38 UTC
[jira] [Commented] (SPARK-2685) Update ExternalAppendOnlyMap to
avoid buffer.remove()
[ https://issues.apache.org/jira/browse/SPARK-2685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074186#comment-14074186 ]
Mridul Muralidharan commented on SPARK-2685:
--------------------------------------------
We moved to using java.util.LinkedList for this
> Update ExternalAppendOnlyMap to avoid buffer.remove()
> -----------------------------------------------------
>
> Key: SPARK-2685
> URL: https://issues.apache.org/jira/browse/SPARK-2685
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Matei Zaharia
>
> This shifts the whole right side of the array back, which can be expensive. It would be better to just swap the last element into the position we want to remove at, then decrease the size of the array.
--
This message was sent by Atlassian JIRA
(v6.2#6252)