[jira] [Commented] (SYSTEMML-739) Explore model-parallel constructs in DML

["Niketan Pansare (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SYSTEMML-739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043214#comment-16043214 ] 

Niketan Pansare commented on SYSTEMML-739:
------------------------------------------

Hi Janardhan,

Welcome to SystemML community !!

Here is a light-weight parameter server implementation that you can look at: https://github.com/dmlc/ps-lite and the corresponding paper: https://www.cs.cmu.edu/~muli/file/parameter_server_osdi14.pdf

To integrate a parameter server with SystemML, you might want to look into how SystemML's bufferpool work and how one can extend DML to support model parallelism. You can begin by reading the papers http://www.vldb.org/pvldb/vol9/p1425-boehm.pdf and https://arxiv.org/pdf/1503.06384.pdf. 

Thanks,

Niketan.

> Explore model-parallel constructs in DML
> ----------------------------------------
>
>                 Key: SYSTEMML-739
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-739
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Niketan Pansare
>
> An example of such construct is providing access to the parameter server.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)