You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@singa.apache.org by "Moaz Reyad (JIRA)" <ji...@apache.org> on 2019/05/21 13:14:00 UTC

[jira] [Created] (SINGA-458) ONNX backend test failed

Moaz Reyad created SINGA-458:
--------------------------------

             Summary: ONNX backend test failed
                 Key: SINGA-458
                 URL: https://issues.apache.org/jira/browse/SINGA-458
             Project: Singa
          Issue Type: Bug
            Reporter: Moaz Reyad


The test of [SINGA ONNX backend|https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224] using [onnx.backend.test.BackendTest|https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052] failed.

There are 1116 unit tests and all of them fail with the error:


{code:sh}
Traceback (most recent call last):
  File "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
    return test_func(*args, device=device, **kwargs)
  File "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py", line 310, in run
    outputs = list(prepared_model.run(inputs))
  File "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py", line 198, in run
    tensors[x.name] = x
AttributeError: 'numpy.ndarray' object has no attribute 'name'

----------------------------------------------------------------------

{code}





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [jira] [Created] (SINGA-458) ONNX backend test failed

Posted by Moaz Reyad <mo...@gmail.com>.
We can pass only a subset of the test cases. This subset corresponds to the
SINGA ONNX operator coverage.

See for example the MXNET ONNX operator coverage:

https://cwiki.apache.org/confluence/display/MXNET/ONNX+Operator+Coverage

Moaz

On Tue, May 21, 2019 at 4:30 PM Wang Wei <wa...@comp.nus.edu.sg> wrote:

> Do we need to pass all 1116 tests?
>
>
>
> On Tue, May 21, 2019 at 9:14 PM Moaz Reyad (JIRA) <ji...@apache.org> wrote:
>
> > Moaz Reyad created SINGA-458:
> > --------------------------------
> >
> >              Summary: ONNX backend test failed
> >                  Key: SINGA-458
> >                  URL: https://issues.apache.org/jira/browse/SINGA-458
> >              Project: Singa
> >           Issue Type: Bug
> >             Reporter: Moaz Reyad
> >
> >
> > The test of [SINGA ONNX backend|
> >
> https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224
> ]
> > using [onnx.backend.test.BackendTest|
> >
> https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052
> ]
> > failed.
> >
> > There are 1116 unit tests and all of them fail with the error:
> >
> >
> > {code:sh}
> > Traceback (most recent call last):
> >   File
> >
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> > line 248, in device_test_func
> >     return test_func(*args, device=device, **kwargs)
> >   File
> >
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> > line 310, in run
> >     outputs = list(prepared_model.run(inputs))
> >   File
> > "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py",
> > line 198, in run
> >     tensors[x.name] = x
> > AttributeError: 'numpy.ndarray' object has no attribute 'name'
> >
> > ----------------------------------------------------------------------
> >
> > {code}
> >
> >
> >
> >
> >
> > --
> > This message was sent by Atlassian JIRA
> > (v7.6.3#76005)
> >
>

Re: [jira] [Created] (SINGA-458) ONNX backend test failed

Posted by Wang Wei <wa...@comp.nus.edu.sg>.
Do we need to pass all 1116 tests?



On Tue, May 21, 2019 at 9:14 PM Moaz Reyad (JIRA) <ji...@apache.org> wrote:

> Moaz Reyad created SINGA-458:
> --------------------------------
>
>              Summary: ONNX backend test failed
>                  Key: SINGA-458
>                  URL: https://issues.apache.org/jira/browse/SINGA-458
>              Project: Singa
>           Issue Type: Bug
>             Reporter: Moaz Reyad
>
>
> The test of [SINGA ONNX backend|
> https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224]
> using [onnx.backend.test.BackendTest|
> https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052]
> failed.
>
> There are 1116 unit tests and all of them fail with the error:
>
>
> {code:sh}
> Traceback (most recent call last):
>   File
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> line 248, in device_test_func
>     return test_func(*args, device=device, **kwargs)
>   File
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> line 310, in run
>     outputs = list(prepared_model.run(inputs))
>   File
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py",
> line 198, in run
>     tensors[x.name] = x
> AttributeError: 'numpy.ndarray' object has no attribute 'name'
>
> ----------------------------------------------------------------------
>
> {code}
>
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v7.6.3#76005)
>