[jira] [Commented] (SPARK-10296) add preservesParitioning parameter to RDD.map

["Sean Owen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716556#comment-14716556 ] 

Sean Owen commented on SPARK-10296:
-----------------------------------

That's an interesting idea. As the comments allude to, I believe this parameter really exists to support mapping key-value pairs when the key doesn't change, and isn't applicable to general map operations. It exists on mapPartitions to support the methods in PairRDDFunctions. So I think the intent is to not expose this for map. You could say, well, it doesn't hurt to expose -- but I think at this point it would change some of the binary API signatures, which could be a blocker obstacle. Not 100% sure on that. 

> add preservesParitioning parameter to RDD.map
> ---------------------------------------------
>
>                 Key: SPARK-10296
>                 URL: https://issues.apache.org/jira/browse/SPARK-10296
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Esteban Donato
>            Priority: Minor
>
> It would be nice to add the Boolean parameter preservesParitioning with default false to RDD.map method just as it is in RDD.mapPartitions method.
> If you agree I can submit a pull request with this enhancement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org