You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@madlib.apache.org by jingyimei <gi...@git.apache.org> on 2018/03/19 19:06:36 UTC
[GitHub] madlib pull request #245: Reduce Install Check run time
GitHub user jingyimei opened a pull request:
https://github.com/apache/madlib/pull/245
Reduce Install Check run time
To reduce the total run time of install check, we looked at the top 5 modules that take longest and modified install check test cases. See each commit for details.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/madlib/madlib reduce_IC_run_time
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/madlib/pull/245.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #245
----
commit bfb3ef87302d80412c72f82194007f088e828974
Author: Jingyi Mei <jm...@...>
Date: 2018-03-16T00:07:44Z
PCA: Refactor IC for pca_project to reduce run time
To reduce the run time for pca_project, we removed calls to
pca_sparse_train and pca_train. Instead, we directly insert data in the
sql file.
Also, we renamed some output table names for simplicity.
Co-authored-by: Nikhil Kak <nk...@pivotal.io>
commit a744b396cd7d21a43f7ac1bfede963a1bae318d9
Author: Jingyi Mei <jm...@...>
Date: 2018-03-16T00:45:23Z
Decision Tree: Modify IC to reduce run time
1. We use a smaller array dataset as input to one of the test case, which
reduced 2/3 of the decision tree IC run time.
2. Reduce n_folds from 5 to 3 in one test case
Co-authored-by: Nikhil Kak <nk...@pivotal.io>
commit f61bf0e88a72506e299060f3e20f062d58338ec6
Author: Jingyi Mei <jm...@...>
Date: 2018-03-16T18:41:15Z
Random Forest: Clean up install check
This commit reorders test cases and adds comments. Besides, it removes
unnecessary casting in queries.
commit 74c650ba3ef56206e86f461c00f61cb1c70fb78a
Author: Jingyi Mei <jm...@...>
Date: 2018-03-16T18:44:26Z
Random Foreset: Reduce install check time
This commit changes num of trees from 100 to 10 in two test cases, so
that the total run time of IC will be reduced.
Co-authored-by: Nikhil Kak <nk...@pivotal.io>
commit c5b88d55a5a9eb25c5dc9ed01f546ab31c4b8f5e
Author: Jngyi Mei and Nikhil Kak <jm...@...>
Date: 2018-03-19T18:31:58Z
Elastic Net: Remove cross validation test
To reduce the Install Check run time for Elastic Net, we removed the
test case with cross validation.
Co-authored-by: Jingyi Mei <jm...@pivotal.io>
Co-authored-by: Nikhil Kak <nk...@pivotal.io>
----
---
[GitHub] madlib pull request #245: Reduce Install Check run time
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/madlib/pull/245
---
[GitHub] madlib issue #245: Reduce Install Check run time
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit commented on the issue:
https://github.com/apache/madlib/pull/245
Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/384/
---
[GitHub] madlib issue #245: Reduce Install Check run time
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit commented on the issue:
https://github.com/apache/madlib/pull/245
Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/382/
---
[GitHub] madlib issue #245: Reduce Install Check run time
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit commented on the issue:
https://github.com/apache/madlib/pull/245
Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/386/
---