[jira] [Resolved] (SPARK-2373) RDD add span function (split an RDD to two RDD based on user's function)

["Josh Rosen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Rosen resolved SPARK-2373.
-------------------------------
    Resolution: Won't Fix

Resolving this as "Won't Fix", per discussion on the PR.  [Matei said|https://github.com/apache/spark/pull/1306#issuecomment-53838250]:

{quote}
IMO this is too specialized to include. It's small enough that applications can do it themselves, but also fairly confusing unless your RDD is already sorted in some way. I think we should just leave it for applications to do it. If you are doing a skewed join operator for example, you can do it within the implementation of that but not show it to the user.
{quote}

> RDD add  span function (split an RDD to two RDD based on user's function)
> -------------------------------------------------------------------------
>
>                 Key: SPARK-2373
>                 URL: https://issues.apache.org/jira/browse/SPARK-2373
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Yanjie Gao
>
> Splits this RDD into a prefix/suffix pair according to a predicate .
> returns
> a pair consisting of the longest prefix of this RDD whose elements all satisfy p, and the rest of this list.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org