You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@horn.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2016/05/24 00:53:12 UTC

[jira] [Created] (HORN-25) Syncopated synchronization for parallel SGD

Edward J. Yoon created HORN-25:
----------------------------------

             Summary: Syncopated synchronization for parallel SGD
                 Key: HORN-25
                 URL: https://issues.apache.org/jira/browse/HORN-25
             Project: Apache Horn
          Issue Type: Bug
            Reporter: Edward J. Yoon


The legacy code is two barriers for merging and broadcasting updates among workers and master. We can reduce this to one barrier by using a syncopated synchronization. For example, master sends previous updated weights and computes newly received updates during waiting for next updates from workers. This will reduce the performance dramatically I think.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)