[GitHub] mg0880gm opened a new issue #8914: The custom operator not supported for group context?

[GitBox <gi...@apache.org>]

mg0880gm opened a new issue #8914: The custom operator not supported for group context?
URL: https://github.com/apache/incubator-mxnet/issues/8914
 
 
   ## Description
   The group context was used for model parallelism of neural network train. The mx.sym.LogisticRegressionOutput works when it's been used for loss calculation, but not customized operator.
   
   ## Environment info (Required)
   OS: Ubuntu 14.04.5 LTS
   Python: 2.7.13
   mxnet: 0.12.1, pulled from master branch and built from source
   
   Package used (Python/R/Scala/Julia):
   Python: mxnet, numpy, scipy
   
   ## Build info (Required if built from source)
   Bulit from command line by following https://mxnet.incubator.apache.org/get_started/install.html
   
   MXNet commit hash:
   2f8c1e83f94e84a25a48d2cd43136030fb3f2d1e
   
   Build config:
   Only change is to enable the profiler.
   
   ## Error Message:
   Traceback (most recent call last):
     File "_ctypes/callbacks.c", line 315, in 'calling callback function'
     File "/git/mxnet/python/mxnet/operator.py", line 621, in creator
       op_prop = prop_cls(**kwargs)
   TypeError: __init__() got an unexpected keyword argument '__ctx_group__'
   
   ## Minimum reproducible example
   The script to generate the network, which works:
   
   ...
   fc2 = mx.symbol.FullyConnected(data=concat, name='fcout_'+str(gpu), num_hidden=out_dim/num_gpus)
   loss = mx.sym.LogisticRegressionOutput(data=fc2, label=labs)
   
   The script to generate the network which used customized operator, and didn't work:
   
   ...
   fc2 = mx.symbol.FullyConnected(data=concat, name='fcout_'+str(gpu), num_hidden=out_dim/num_gpus)
   act2 = mx.sym.Activation(data=fc2, name='acout_'+str(gpu), act_type='sigmoid')
   loss = mx.sym.Custom(data=act2, label=label, name='ce_'+str(gpu), op_type='CrossEntropyLoss')
   
   Is this because the custom op is not support yet for group context?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services