You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ma...@apache.org on 2013/11/25 00:52:44 UTC
[5/5] git commit: Merge pull request #185 from
mkolod/random-number-generator
Merge pull request #185 from mkolod/random-number-generator
XORShift RNG with unit tests and benchmark
This patch was introduced to address SPARK-950 - the discussion below the ticket explains not only the rationale, but also the design and testing decisions: https://spark-project.atlassian.net/browse/SPARK-950
To run unit test, start SBT console and type:
compile
test-only org.apache.spark.util.XORShiftRandomSuite
To run benchmark, type:
project core
console
Once the Scala console starts, type:
org.apache.spark.util.XORShiftRandom.benchmark(100000000)
XORShiftRandom is also an object with a main method taking the
number of iterations as an argument, so you can also run it
from the command line.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/65de73c7
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/65de73c7
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/65de73c7
Branch: refs/heads/master
Commit: 65de73c7f8529be363e9ae814d0d4eab0da112aa
Parents: 972171b 2272465
Author: Matei Zaharia <ma...@eecs.berkeley.edu>
Authored: Sun Nov 24 15:52:33 2013 -0800
Committer: Matei Zaharia <ma...@eecs.berkeley.edu>
Committed: Sun Nov 24 15:52:33 2013 -0800
----------------------------------------------------------------------
.../scala/org/apache/spark/util/Utils.scala | 24 +++++
.../org/apache/spark/util/XORShiftRandom.scala | 94 ++++++++++++++++++++
.../apache/spark/util/XORShiftRandomSuite.scala | 76 ++++++++++++++++
.../apache/spark/mllib/clustering/KMeans.scala | 11 +--
4 files changed, 200 insertions(+), 5 deletions(-)
----------------------------------------------------------------------