You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemml.apache.org by de...@apache.org on 2017/08/28 17:37:09 UTC
[2/4] systemml git commit: [DOC][HOTFIX] updatest to the performance
test scripts
[DOC][HOTFIX] updatest to the performance test scripts
Closes #616
Project: http://git-wip-us.apache.org/repos/asf/systemml/repo
Commit: http://git-wip-us.apache.org/repos/asf/systemml/commit/07bd40a4
Tree: http://git-wip-us.apache.org/repos/asf/systemml/tree/07bd40a4
Diff: http://git-wip-us.apache.org/repos/asf/systemml/diff/07bd40a4
Branch: refs/heads/gh-pages
Commit: 07bd40a43bf1bbed2ac9e2ec95fcf7949cc35801
Parents: 16f72cf
Author: krishnakalyan3 <kr...@gmail.com>
Authored: Mon Aug 14 15:18:50 2017 -0700
Committer: Nakul Jindal <na...@gmail.com>
Committed: Mon Aug 14 15:18:50 2017 -0700
----------------------------------------------------------------------
python-performance-test.md | 15 ++++++++++++++-
1 file changed, 14 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/systemml/blob/07bd40a4/python-performance-test.md
----------------------------------------------------------------------
diff --git a/python-performance-test.md b/python-performance-test.md
index 3d29f01..ce36c2d 100644
--- a/python-performance-test.md
+++ b/python-performance-test.md
@@ -177,7 +177,20 @@ In the example above `--tag` can be a major/minor systemml version and `--auth`
Currently we only support time difference between algorithms in different versions. This can be obtained by running the script below
`./stats.py --auth client_json.json --exec-mode singlenode --tags 1.0 2.0`
-Note: Please pip install `https://github.com/burnash/gspread` to use google docs client.
+We pass different `matrix shapes` using `--mat-shape` argument.
+
+Matrix Shape | Approximate Data Size
+--- | --- |
+10k_1k|80MB
+100k_1k|800MB
+1M_1k|8GB
+10M_1k|80GB
+100M_1k|800GB
+
+For example the command below runs performance test for all data sizes described above
+`run_perftest.py --family binomial clustering multinomial regression1 regression2 stats1 stats2 --mat-shape 10k_1k 100k_1k 1M_1k 10M_1k 100M_1k --master yarn-client --temp-dir hdfs://localhost:9000/user/systemml`
+
+Note: Please use this command `pip3 install -r requirements.txt` before using the perftest scripts.
## Troubleshooting