You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Madhu Siddalingaiah (JIRA)" <ji...@apache.org> on 2014/05/22 19:29:02 UTC

[jira] [Commented] (SPARK-983) External hashing & sorting support

    [ https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006161#comment-14006161 ] 

Madhu Siddalingaiah commented on SPARK-983:
-------------------------------------------

Can someone comment on the scope of this feature?
My specific interest is to sort each partition in an RDD given a comparison function.
This can be done now if all partitions fit in memory, but I don't see an easy way to do it if partitions are larger than available memory.

> External hashing & sorting support
> ----------------------------------
>
>                 Key: SPARK-983
>                 URL: https://issues.apache.org/jira/browse/SPARK-983
>             Project: Spark
>          Issue Type: New Feature
>    Affects Versions: 0.9.0
>            Reporter: Reynold Xin
>            Assignee: Aaron Davidson
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)