You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2013/12/19 22:35:21 UTC
[4/4] git commit: Merge pull request #276 from
shivaram/collectPartition
Merge pull request #276 from shivaram/collectPartition
Add collectPartition to JavaRDD interface.
This interface is useful for implementing `take` from other language frontends where the data is serialized. Also remove `takePartition` from PythonRDD and use `collectPartition` in rdd.py.
Thanks @concretevitamin for the original change and tests.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/7990c563
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/7990c563
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/7990c563
Branch: refs/heads/master
Commit: 7990c5637519ae2def30dfba19b7c83562c0ec00
Parents: 440e531 9cc3a6d
Author: Reynold Xin <rx...@apache.org>
Authored: Thu Dec 19 13:35:09 2013 -0800
Committer: Reynold Xin <rx...@apache.org>
Committed: Thu Dec 19 13:35:09 2013 -0800
----------------------------------------------------------------------
.../org/apache/spark/api/java/JavaRDDLike.scala | 11 +++++++
.../org/apache/spark/api/python/PythonRDD.scala | 4 ---
.../scala/org/apache/spark/JavaAPISuite.java | 33 ++++++++++++++++++++
python/pyspark/context.py | 3 --
python/pyspark/rdd.py | 7 ++++-
5 files changed, 50 insertions(+), 8 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/7990c563/python/pyspark/rdd.py
----------------------------------------------------------------------