You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@systemds.apache.org by ss...@apache.org on 2022/04/22 10:45:30 UTC

[systemds] branch main updated (d8db20fa04 -> dc3bf462a3)

This is an automated email from the ASF dual-hosted git repository.

ssiddiqi pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/systemds.git


    from d8db20fa04 [MINOR] Removing unused imports (leftovers of recent refactoring)
     add dc3bf462a3 [SYSTEMDS-3347] Flatten the nested loop for parallel pipelines execution  - This commit flattens the nested parfor loop in run_with_hyperparam()     to increase the degree of parallelism by materializing the pipelines and     resource hyper-parameters together in one frame and then execute them in a single parfor    instead of parfor over pipelines and then nesting for hyper-parameters  - This commit also introduce a frame builtin freplicate() that takes two parameters [...]

No new revisions were added by this update.

Summary of changes:
 scripts/builtin/applyAndEvaluate.dml               |   4 +-
 scripts/builtin/bandit.dml                         | 325 +++++++++++++++------
 scripts/builtin/topk_cleaning.dml                  |  15 +-
 scripts/pipelines/scripts/enumerateLogical.dml     |  51 ++--
 scripts/pipelines/scripts/utils.dml                |  21 +-
 .../java/org/apache/sysds/common/Builtins.java     |   1 +
 src/main/java/org/apache/sysds/common/Types.java   |   7 +-
 .../sysds/parser/BuiltinFunctionExpression.java    |   1 +
 .../org/apache/sysds/parser/DMLTranslator.java     |   1 +
 .../sysds/runtime/functionobjects/Builtin.java     |   5 +-
 .../runtime/instructions/CPInstructionParser.java  |   1 +
 .../runtime/instructions/InstructionUtils.java     |   2 +
 .../runtime/instructions/SPInstructionParser.java  |   1 +
 .../cp/BinaryFrameFrameCPInstruction.java          |   6 +
 .../sysds/runtime/matrix/data/FrameBlock.java      |  11 +
 .../BuiltinTopkCleaningClassificationTest.java     |   4 +-
 .../BuiltinTopkCleaningRegressionTest.java         |   1 -
 .../pipelines/BuiltinTopkEvaluateTest.java         |   6 +-
 .../intermediates/classification/applyFunc.csv     |   6 +-
 .../intermediates/classification/bestAcc.csv       |   6 +-
 .../pipelines/intermediates/classification/hp.csv  |   6 +-
 .../pipelines/intermediates/classification/pip.csv |   6 +-
 .../intermediates/regression/applyFunc.csv         |  10 +-
 .../functions/pipelines/topkLogicalTest.dml        |   2 +-
 .../pipelines/topkcleaningClassificationTest.dml   |  12 +-
 .../pipelines/topkcleaningRegressionTest.dml       |  12 +-
 26 files changed, 369 insertions(+), 154 deletions(-)