You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2018/10/11 14:05:04 UTC
[GitHub] vafl opened a new issue #12795: Deserialization problem with gluon
`ValueError: There are multiple outputs with name ...`
vafl opened a new issue #12795: Deserialization problem with gluon `ValueError: There are multiple outputs with name ...`
URL: https://github.com/apache/incubator-mxnet/issues/12795
## Description
For a simple HybridBlock, saving and deserializing the symbol fails with mxnet 1.3 when an embedding layer is used multiple times. This used to work with mxnet 1.2
It may or may not be related to this issue: https://github.com/apache/incubator-mxnet/issues/12783
## Environment info (Required)
```
----------Python Info----------
Version : 3.6.3
Compiler : GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.39.2)
Build : ('default', 'Mar 20 2018 21:25:13')
Arch : ('64bit', '')
------------Pip Info-----------
Version : 18.1
Directory : /Users/.../.pyenv/versions/3.6.3/Python.framework/Versions/3.6/lib/python3.6/site-packages/pip
----------MXNet Info-----------
Version : 1.3.0
Directory : /Users/.../.pyenv/versions/3.6.3/Python.framework/Versions/3.6/lib/python3.6/site-packages/mxnet
Commit Hash : b3be92f4a48bce62a5a8424271871c2f81c8f7f1
----------System Info----------
Platform : Darwin-16.7.0-x86_64-i386-64bit
system : Darwin
node : ...
release : 16.7.0
version : Darwin Kernel Version 16.7.0: Thu Jun 21 20:07:39 PDT 2018; root:xnu-3789.73.14~1/RELEASE_X86_64
----------Hardware Info----------
machine : x86_64
processor : i386
b'machdep.cpu.extfeatures: SYSCALL XD 1GBPAGE EM64T LAHF LZCNT PREFETCHW RDTSCP TSCI'
b'machdep.cpu.leaf7_features: SMEP ERMS RDWRFSGS TSC_THREAD_OFFSET BMI1 HLE AVX2 BMI2 INVPCID RTM SMAP RDSEED ADX IPT SGX FPU_CSDS MPX CLFSOPT'
b'machdep.cpu.features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 PCLMULQDQ DTES64 MON DSCPL VMX SMX EST TM2 SSSE3 FMA CX16 TPR PDCM SSE4.1 SSE4.2 x2APIC MOVBE POPCNT AES PCID XSAVE OSXSAVE SEGLIM64 TSCTMR AVX1.0 RDRAND F16C'
b'machdep.cpu.brand_string: Intel(R) Core(TM) i7-7660U CPU @ 2.50GHz'
----------Network Test----------
Setting timeout: 10
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0440 sec, LOAD: 0.9637 sec.
Timing for Gluon Tutorial(en): http://gluon.mxnet.io, DNS: 0.0922 sec, LOAD: 1.0902 sec.
Timing for Gluon Tutorial(cn): https://zh.gluon.ai, DNS: 0.0733 sec, LOAD: 0.8020 sec.
Timing for FashionMNIST: https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.0545 sec, LOAD: 0.6035 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0400 sec, LOAD: 1.1772 sec.
Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0443 sec, LOAD: 0.2266 sec.
```
Package used (Python/R/Scala/Julia):
I'm using python
## Error Message:
(Paste the complete error message, including stack trace.)
```
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
<ipython-input-8-628e9346e9c4> in <module>()
21 test_op.export('/tmp/bla')
22
---> 23 mx.gluon.SymbolBlock.imports('/tmp/bla-symbol.json', param_file='/tmp/bla-0000.params', input_names=['data0', 'data1'])
~/.pyenv/versions/3.6.3/Python.framework/Versions/3.6/lib/python3.6/site-packages/mxnet/gluon/block.py in imports(symbol_file, input_names, param_file, ctx)
1021 input_names = [input_names]
1022 inputs = [symbol.var(i) for i in input_names]
-> 1023 ret = SymbolBlock(sym, inputs)
1024 if param_file is not None:
1025 ret.collect_params().load(param_file, ctx=ctx)
~/.pyenv/versions/3.6.3/Python.framework/Versions/3.6/lib/python3.6/site-packages/mxnet/gluon/block.py in __init__(self, outputs, inputs, params)
1049 row_sparse_storage = ndarray.ndarray._STORAGE_TYPE_STR_TO_ID['row_sparse']
1050 for i in out:
-> 1051 for j in i.get_internals():
1052 assert(j.attr("__storage_type__") != str(row_sparse_storage)), \
1053 "SymbolBlock doesn't support Parameter '%s' because its storage " \
~/.pyenv/versions/3.6.3/Python.framework/Versions/3.6/lib/python3.6/site-packages/mxnet/symbol/symbol.py in <genexpr>(.0)
91 <Symbol _plus0>
92 """
---> 93 return (self[i] for i in self.list_outputs())
94
95 def __add__(self, other):
~/.pyenv/versions/3.6.3/Python.framework/Versions/3.6/lib/python3.6/site-packages/mxnet/symbol/symbol.py in __getitem__(self, index)
515 if name == index:
516 if idx is not None:
--> 517 raise ValueError('There are multiple outputs with name \"%s\"' % index)
518 idx = i
519 if idx is None:
ValueError: There are multiple outputs with name "testop1_embedding0_fwd_output"
```
## Minimum reproducible example
```python
import mxnet as mx
from mxnet import gluon
class TestOp(gluon.HybridBlock):
def __init__(self, n_in, n_out):
super().__init__()
with self.name_scope():
self.embed = mx.gluon.nn.Embedding(n_in, n_out)
def hybrid_forward(self, F, x, y):
a = self.embed(x)
b = self.embed(y)
return a + b
test_op = TestOp(n_in=5, n_out=2)
test_op.initialize()
test_op.hybridize()
test_op(mx.nd.array([0,1,2]), mx.nd.array([1,2,3]))
test_op.export('/tmp/bla')
gluon.SymbolBlock.imports(
'/tmp/bla-symbol.json',
param_file='/tmp/bla-0000.params',
input_names=['data0', 'data1'])
```
## Steps to reproduce
Run the code.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services