You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "koert kuipers (JIRA)" <ji...@apache.org> on 2014/05/12 02:45:17 UTC

[jira] [Created] (SPARK-1801) Open up sime private APIs related to creating new RDDs for developers

koert kuipers created SPARK-1801:
------------------------------------

             Summary: Open up sime private APIs related to creating new RDDs for developers
                 Key: SPARK-1801
                 URL: https://issues.apache.org/jira/browse/SPARK-1801
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 1.0.0
            Reporter: koert kuipers
            Priority: Minor


in writing my own RDD i ran into a few issues with respect to stuff being private in spark.

in compute i would like to return an iterator that respects task killing (as HadoopRDD does), but the mechanics for that are inside the private InterruptibleIterator. also the exception i am supposed to throw (TaskKilledException) is private to spark.

See also:
http://apache-spark-user-list.1001560.n3.nabble.com/Re-writing-my-own-RDD-td5558.html



--
This message was sent by Atlassian JIRA
(v6.2#6252)