You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@systemml.apache.org by "LI Guobao (JIRA)" <ji...@apache.org> on 2018/05/13 16:28:00 UTC

[jira] [Created] (SYSTEMML-2324) Synchronization

LI Guobao created SYSTEMML-2324:
-----------------------------------

             Summary: Synchronization
                 Key: SYSTEMML-2324
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2324
             Project: SystemML
          Issue Type: Sub-task
            Reporter: LI Guobao
            Assignee: LI Guobao


We also need to implement the synchronization between workers and parameter server to be able to bring more parameter update strategies, e.g., the stale-synchronous strategy needs a hyperparameter "staleness" to define the waiting interval. The idea is to maintain a vector clock recording all workers' clock in the server. Each time when an iteration in side of worker finishes, it waits server to give a signal, i.e., to send a request for calculating the staleness according to the vector clock. And when the server receives the gradients from certain worker, it will increment the vector clock for this worker. So we could define BSP as "staleness==0", ASP as "staleness==-1" and SSP as "staleness==N".



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)