You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@singa.apache.org by "Jinyang Gao (JIRA)" <ji...@apache.org> on 2015/10/06 11:58:28 UTC

[jira] [Created] (SINGA-83) Param Hashing

Jinyang Gao created SINGA-83:
--------------------------------

             Summary: Param Hashing
                 Key: SINGA-83
                 URL: https://issues.apache.org/jira/browse/SINGA-83
             Project: Singa
          Issue Type: Improvement
            Reporter: Jinyang Gao


Param hashing will be a very useful technique to reduce communication cost of deep learning parameter. It can reduce the param size by 20x with little impact on model accuracy. Further details can be seen in the following icml paper. Research problems can be done after the second release.

http://arxiv.org/pdf/1504.04788.pdf
http://arxiv.org/pdf/1306.0543v2.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)