You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@mxnet.apache.org by Alfredo Luque <al...@airbnb.com.INVALID> on 2018/09/12 01:05:09 UTC

Regressions in NDArrayIter

Looks like https://github.com/apache/incubator-mxnet/pull/12285 broke a ton
of our test cases iterating over 3D NDArray instances (eg; MNIST) by
creating an index out of range.

Stacktrace:

.com/airbnb/bighead/python/bighead/ml_frameworks/mxnet/gluon.py", line
434, in transform
    for batch in data_iter:
  File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
line 228, in __next__
    return self.next()
  File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
line 680, in next
    label = self.getlabel()
  File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
line 750, in getlabel
    return self._batchify(self.label)
  File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
line 732, in _batchify
    first_data = self._getdata(data_source, start=self.cursor)
  File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
line 694, in _getdata
    end = end if end is not None else data_source[0][1].shape[0]
IndexError: list index out of range

I’ve created an issue at
https://github.com/apache/incubator-mxnet/issues/12526


We’ll be pinning to the previous build until it’s reverted/patched, but let
us know if we can help provide more regression tests here.

—
Alfredo Luque
Software Engineer
Machine Learning Infrastructure
Airbnb
San Francisco, CA

Re: Regressions in NDArrayIter

Posted by Jake Lee <gs...@gmail.com>.

I am looking into it.

Could you provide the shape of NDArrayIter and minimal reproducible code?
Thank you so much!

Alfredo Luque <al...@airbnb.com.invalid> 於 2018年9月11日 週二 下午6:05寫道：

> Looks like https://github.com/apache/incubator-mxnet/pull/12285 broke a
> ton
> of our test cases iterating over 3D NDArray instances (eg; MNIST) by
> creating an index out of range.
>
> Stacktrace:
>
> .com/airbnb/bighead/python/bighead/ml_frameworks/mxnet/gluon.py", line
> 434, in transform
>     for batch in data_iter:
>   File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
> line 228, in __next__
>     return self.next()
>   File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
> line 680, in next
>     label = self.getlabel()
>   File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
> line 750, in getlabel
>     return self._batchify(self.label)
>   File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
> line 732, in _batchify
>     first_data = self._getdata(data_source, start=self.cursor)
>   File "/anaconda3/envs/py36/lib/python3.6/site-packages/mxnet/io/io.py",
> line 694, in _getdata
>     end = end if end is not None else data_source[0][1].shape[0]
> IndexError: list index out of range
>
> I’ve created an issue at
> https://github.com/apache/incubator-mxnet/issues/12526
>
>
> We’ll be pinning to the previous build until it’s reverted/patched, but let
> us know if we can help provide more regression tests here.
>
> —
> Alfredo Luque
> Software Engineer
> Machine Learning Infrastructure
> Airbnb
> San Francisco, CA
>