[jira] [Commented] (SINGA-251) Implement image loader for pysinga

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SINGA-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548829#comment-15548829 ] 

ASF subversion and git services commented on SINGA-251:
-------------------------------------------------------

Commit 064f3fb97f37995c4db9565c6abac6676812c2ad in incubator-singa's branch refs/heads/master from [~wangwei.cs]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=064f3fb ]

SINGA-251 - Implement image loader for pysinga

Add ImageBatchIter in data.py, which prefetches images into mini-batches
and pre-processes images using user defined transform function.
The process is done in another process via multiprocessing

fixed a bug in merge layer which should replicate the gradients in the returned values


> Implement image loader for pysinga
> ----------------------------------
>
>                 Key: SINGA-251
>                 URL: https://issues.apache.org/jira/browse/SINGA-251
>             Project: Singa
>          Issue Type: New Feature
>            Reporter: wangwei
>
> Image loading and pre-processing typically takes a long time, which would become the bottleneck of training when loading time > BP time.
> This ticket would implement an image loader which fetches the images and conducts pre-processing using multi-threading via multiprocessing module from python.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)