You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemds.apache.org by ss...@apache.org on 2022/04/22 10:45:30 UTC
[systemds] branch main updated (d8db20fa04 -> dc3bf462a3)
This is an automated email from the ASF dual-hosted git repository.
ssiddiqi pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/systemds.git
from d8db20fa04 [MINOR] Removing unused imports (leftovers of recent refactoring)
add dc3bf462a3 [SYSTEMDS-3347] Flatten the nested loop for parallel pipelines execution - This commit flattens the nested parfor loop in run_with_hyperparam() to increase the degree of parallelism by materializing the pipelines and resource hyper-parameters together in one frame and then execute them in a single parfor instead of parfor over pipelines and then nesting for hyper-parameters - This commit also introduce a frame builtin freplicate() that takes two parameters [...]
No new revisions were added by this update.
Summary of changes:
scripts/builtin/applyAndEvaluate.dml | 4 +-
scripts/builtin/bandit.dml | 325 +++++++++++++++------
scripts/builtin/topk_cleaning.dml | 15 +-
scripts/pipelines/scripts/enumerateLogical.dml | 51 ++--
scripts/pipelines/scripts/utils.dml | 21 +-
.../java/org/apache/sysds/common/Builtins.java | 1 +
src/main/java/org/apache/sysds/common/Types.java | 7 +-
.../sysds/parser/BuiltinFunctionExpression.java | 1 +
.../org/apache/sysds/parser/DMLTranslator.java | 1 +
.../sysds/runtime/functionobjects/Builtin.java | 5 +-
.../runtime/instructions/CPInstructionParser.java | 1 +
.../runtime/instructions/InstructionUtils.java | 2 +
.../runtime/instructions/SPInstructionParser.java | 1 +
.../cp/BinaryFrameFrameCPInstruction.java | 6 +
.../sysds/runtime/matrix/data/FrameBlock.java | 11 +
.../BuiltinTopkCleaningClassificationTest.java | 4 +-
.../BuiltinTopkCleaningRegressionTest.java | 1 -
.../pipelines/BuiltinTopkEvaluateTest.java | 6 +-
.../intermediates/classification/applyFunc.csv | 6 +-
.../intermediates/classification/bestAcc.csv | 6 +-
.../pipelines/intermediates/classification/hp.csv | 6 +-
.../pipelines/intermediates/classification/pip.csv | 6 +-
.../intermediates/regression/applyFunc.csv | 10 +-
.../functions/pipelines/topkLogicalTest.dml | 2 +-
.../pipelines/topkcleaningClassificationTest.dml | 12 +-
.../pipelines/topkcleaningRegressionTest.dml | 12 +-
26 files changed, 369 insertions(+), 154 deletions(-)