[jira] [Commented] (SYSTEMML-1695) Create design/investigation document for parameter server

["Janardhan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SYSTEMML-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16087707#comment-16087707 ] 

Janardhan commented on SYSTEMML-1695:
-------------------------------------

Hi Niketan, 

Can you comment on this, [DNC architecture|https://deepmind.com/research/dnc/], related to this jira?. For me, it seems there is a bit of inspiration in this particular architecture for the constructs.

> Create design/investigation document for parameter server
> ---------------------------------------------------------
>
>                 Key: SYSTEMML-1695
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1695
>             Project: SystemML
>          Issue Type: Sub-task
>            Reporter: Niketan Pansare
>            Assignee: Janardhan
>
> Here are relevant links:
> - https://issues.apache.org/jira/browse/SPARK-4590
> - https://issues.apache.org/jira/browse/SPARK-6932
> - https://docs.google.com/document/d/1SX3nkmF41wFXAAIr9BgqvrHSS5mW362fJ7roBXJm06o/edit
> This document need not cover how to integrate a parameter server in SystemML (which comes later), but should discuss following questions:
> 1. Should we integrate existing parameter server implementation or build one from scratch ? What are the pros and cons of each approaches ? For example: https://github.com/rjagerman/glint
> 2. If we plan to integrate existing parameter server implementation, what is the interface ? (for exampe: update(matrix, new matrix) or update(matrix, delta)).
> 3. Can parameter server help in ML algorithms ? Some experiments might be helpful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)