You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemml.apache.org by de...@apache.org on 2017/02/02 02:18:44 UTC
incubator-systemml git commit: [SYSTEMML-1226] Add python validation
to release process
Repository: incubator-systemml
Updated Branches:
refs/heads/master f275f1a36 -> 9f26b04a1
[SYSTEMML-1226] Add python validation to release process
Describe python test execution for release validation.
Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/9f26b04a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/9f26b04a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-systemml/diff/9f26b04a
Branch: refs/heads/master
Commit: 9f26b04a133fe42bc412b159bc4068ae9521d3f5
Parents: f275f1a
Author: Deron Eriksson <de...@us.ibm.com>
Authored: Wed Feb 1 18:14:10 2017 -0800
Committer: Deron Eriksson <de...@us.ibm.com>
Committed: Wed Feb 1 18:14:10 2017 -0800
----------------------------------------------------------------------
docs/release-process.md | 20 ++++++++++++++++++++
1 file changed, 20 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/9f26b04a/docs/release-process.md
----------------------------------------------------------------------
diff --git a/docs/release-process.md b/docs/release-process.md
index d734f4f..1cc5c9f 100644
--- a/docs/release-process.md
+++ b/docs/release-process.md
@@ -184,6 +184,26 @@ sanity check on OS X after building the artifacts manually.
hadoop jar SystemML.jar -s "print('hello world');"
+## Python Tests
+
+For Spark 1.*, the Python tests at (`src/main/python/tests`) can be executed in the following manner:
+
+ PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_matrix_agg_fn.py
+ PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_matrix_binary_op.py
+ PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mlcontext.py
+ PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mllearn_df.py
+ PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mllearn_numpy.py
+
+For Spark 2.*, pyspark can't be used to run the Python tests, so they can be executed using
+spark-submit:
+
+ spark-submit --driver-class-path SystemML.jar test_matrix_agg_fn.py
+ spark-submit --driver-class-path SystemML.jar test_matrix_binary_op.py
+ spark-submit --driver-class-path SystemML.jar test_mlcontext.py
+ spark-submit --driver-class-path SystemML.jar test_mllearn_df.py
+ spark-submit --driver-class-path SystemML.jar test_mllearn_numpy.py
+
+
## Check LICENSE and NOTICE Files
<a href="#release-candidate-checklist">Up to Checklist</a>