You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2015/08/26 22:04:46 UTC
[jira] [Commented] (SPARK-2991) RDD transforms for scan and
scanLeft
[ https://issues.apache.org/jira/browse/SPARK-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715417#comment-14715417 ]
Erik Erlandson commented on SPARK-2991:
---------------------------------------
This RFE now has a [pull-req|https://github.com/willb/silex/pull/28] against the 3rd-party [silex|https://github.com/willb/silex] library:
https://github.com/willb/silex/pull/28
> RDD transforms for scan and scanLeft
> -------------------------------------
>
> Key: SPARK-2991
> URL: https://issues.apache.org/jira/browse/SPARK-2991
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Erik Erlandson
> Assignee: Erik Erlandson
> Priority: Minor
> Labels: features
>
> Provide RDD transforms analogous to Scala scan(z)(f) (parallel prefix scan) and scanLeft(z)(f) (sequential prefix scan)
> Discussion of a scanLeft implementation:
> http://erikerlandson.github.io/blog/2014/08/09/implementing-an-rdd-scanleft-transform-with-cascade-rdds/
> Discussion of scan:
> http://erikerlandson.github.io/blog/2014/08/12/implementing-parallel-prefix-scan-as-a-spark-rdd-transform/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org