[jira] [Created] (SINGA-234) Unify the engines for cudnn and singa layers

["wangwei (JIRA)" <ji...@apache.org>]

wangwei created SINGA-234:
-----------------------------

             Summary: Unify the engines for cudnn and singa layers
                 Key: SINGA-234
                 URL: https://issues.apache.org/jira/browse/SINGA-234
             Project: Singa
          Issue Type: Improvement
            Reporter: wangwei


For most layers, we would have multiple implementations, e.g., using cudnn for nvidia gpu, using cpp for cpu and using opencl for other gpus.

These layers have different classes. They are registered with different identifiers. This ticket would unify the layer identifiers for each engine:
1. cudnn layers are registered with identifier = cudnn_xxx, e.g., cudnn_convolution for the CudnnConvolution layer.
2. singa layers are registered with identifier = singa_xxx, e.g., singa_convolution for the Convolution layer.

cudnn engine must run on cuda devices. and singa engine could run on cuda-gpu device or cpp-cpu device depending on the layer type. For instance, the Convolution layer must run on cpp-cpu device, and Dense layer can run on both devices and would select the correct device automatically.

Users need to make sure the engine and the device of the tensors.

Both CPP and Python code is updated. Users have to compose the layer identifier manually for CPP version. For Python version, users can set layer.engine='cudnn' or 'singa'. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)