You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@systemml.apache.org by "Mike Dusenberry (JIRA)" <ji...@apache.org> on 2017/07/12 00:27:00 UTC

[jira] [Created] (SYSTEMML-1760) Improve engine robustness of distributed SGD training

Mike Dusenberry created SYSTEMML-1760:
-----------------------------------------

             Summary: Improve engine robustness of distributed SGD training
                 Key: SYSTEMML-1760
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1760
             Project: SystemML
          Issue Type: Improvement
            Reporter: Mike Dusenberry
            Assignee: Fei Hu


Currently, we have a mathematical framework in place for training with distributed SGD in a [distributed MNIST LeNet example | https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet_distrib_sgd.dml].  This task aims to push this at scale to determine (1) the current behavior of the engine (i.e. does the optimizer actually run this in a distributed fashion, and (2) ways to improve the robustness and performance for this scenario.  The distributed SGD framework from this example has already been ported into Caffe2DML, and thus improvements made for this task will directly benefit our efforts towards distributed training of Caffe models (and Keras in the future).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)