You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Aaron Davidson (JIRA)" <ji...@apache.org> on 2014/05/14 09:57:15 UTC

[jira] [Resolved] (SPARK-1801) Open up some private APIs related to creating new RDDs for developers

     [ https://issues.apache.org/jira/browse/SPARK-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Davidson resolved SPARK-1801.
-----------------------------------

    Resolution: Fixed

https://github.com/apache/spark/pull/764

> Open up some private APIs related to creating new RDDs for developers
> ---------------------------------------------------------------------
>
>                 Key: SPARK-1801
>                 URL: https://issues.apache.org/jira/browse/SPARK-1801
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.0.0
>            Reporter: koert kuipers
>            Priority: Minor
>
> in writing my own RDD i ran into a few issues with respect to stuff being private in spark.
> in compute i would like to return an iterator that respects task killing (as HadoopRDD does), but the mechanics for that are inside the private InterruptibleIterator. also the exception i am supposed to throw (TaskKilledException) is private to spark.
> See also:
> http://apache-spark-user-list.1001560.n3.nabble.com/Re-writing-my-own-RDD-td5558.html



--
This message was sent by Atlassian JIRA
(v6.2#6252)