You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemml.apache.org by de...@apache.org on 2017/08/28 17:37:11 UTC
[4/4] systemml git commit: [MINOR][DOC] Perf Test Google sheets API
[MINOR][DOC] Perf Test Google sheets API
Instructions on how to configure the google client API for performance tests.
Closes #642.
Project: http://git-wip-us.apache.org/repos/asf/systemml/repo
Commit: http://git-wip-us.apache.org/repos/asf/systemml/commit/4e22b91e
Tree: http://git-wip-us.apache.org/repos/asf/systemml/tree/4e22b91e
Diff: http://git-wip-us.apache.org/repos/asf/systemml/diff/4e22b91e
Branch: refs/heads/gh-pages
Commit: 4e22b91ea6d486998fc38748d3178dd1b8f739da
Parents: fdc2be2
Author: krishnakalyan3 <kr...@gmail.com>
Authored: Mon Aug 28 10:32:55 2017 -0700
Committer: Deron Eriksson <de...@apache.org>
Committed: Mon Aug 28 10:32:55 2017 -0700
----------------------------------------------------------------------
python-performance-test.md | 23 ++++++++++++++++++++++-
1 file changed, 22 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/systemml/blob/4e22b91e/python-performance-test.md
----------------------------------------------------------------------
diff --git a/python-performance-test.md b/python-performance-test.md
index 25e1f35..b47b7c9 100644
--- a/python-performance-test.md
+++ b/python-performance-test.md
@@ -148,6 +148,27 @@ Run performance test for all algorithms under the family `regression2` and log w
Run performance test for all algorithms using HDFS.
+## Google sheets API
+
+Steps below to configure google client API:
+
+- Navigate to [Google APIs Console](https://console.developers.google.com/apis/).
+- Create a new project.
+- Click Enable API. Search for and enable the Google Drive API.
+- Create credentials for a Web Server to access Application Data.
+- Name the service account and grant it a Project Role of Editor.
+- Download the JSON file.
+- Copy the JSON file to your code directory and rename it to client_secret.json
+
+Steps below to configure google sheets:
+
+- Create a new spread sheet with google sheets.
+- Create seperate sheets for `singlenode` and `hybrid_spark`.
+- Find the client_email inside client_secret.json and save it.
+- Back in your spreadsheet, click the Share button in the top right, and paste the client email into the People field to give it edit rights for each sheet.
+- Click Send
+
+
## Result Consolidation and Plotting
We have two scripts, `stats.py` forpulling results from google docs and `update.py` to updating results to google docs or local file system.
@@ -159,6 +180,7 @@ Example of `stats.py` below
` ./stats.py --auth ../key/client_json.json --exec-type singlenode --plot stats1_data-gen_none_dense_10k_100`
`--plot` argument needs the name of the composite key that you would like to compare results over. If this argument is not specified the results would be grouped by keys.
+
## Operational Notes
All performance test depend mainly on two scripts for execution `systemml-standalone.py` and `systemml-spark-submit.py`. Incase we need to change standalone or spark parameters we need to manually change these parameters in their respective scripts.
@@ -198,7 +220,6 @@ Matrix Shape | Approximate Data Size
10M_1k|80GB
100M_1k|800GB
-
For example the command below runs performance test for all data sizes described above
`run_perftest.py --family binomial clustering multinomial regression1 regression2 stats1 stats2 --mat-shape 10k_1k 100k_1k 1M_1k 10M_1k 100M_1k --master yarn-client --temp-dir hdfs://localhost:9000/user/systemml`