You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2013/10/13 06:23:58 UTC
[3/3] git commit: Merge pull request #52 from
harveyfeng/hadoop-closure
Merge pull request #52 from harveyfeng/hadoop-closure
Add an optional closure parameter to HadoopRDD instantiation to use when creating local JobConfs.
Having HadoopRDD accept this optional closure eliminates the need for the HadoopFileRDD added earlier. It makes the HadoopRDD more general, in that the caller can specify any JobConf initialization flow.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/99796904
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/99796904
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/99796904
Branch: refs/heads/master
Commit: 99796904ae9d00405584ac518b6144973a876e3c
Parents: dca8009 6c32aab
Author: Reynold Xin <rx...@apache.org>
Authored: Sat Oct 12 21:23:26 2013 -0700
Committer: Reynold Xin <rx...@apache.org>
Committed: Sat Oct 12 21:23:26 2013 -0700
----------------------------------------------------------------------
.../scala/org/apache/spark/SparkContext.scala | 29 ++++-------
.../scala/org/apache/spark/rdd/HadoopRDD.scala | 52 ++++++--------------
2 files changed, 26 insertions(+), 55 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/99796904/core/src/main/scala/org/apache/spark/SparkContext.scala
----------------------------------------------------------------------