[GitHub] RuRo commented on issue #12619: Too large max depth value in _recursive_fork_recordio

[GitBox <gi...@apache.org>]

RuRo commented on issue #12619: Too large max depth value in _recursive_fork_recordio
URL: https://github.com/apache/incubator-mxnet/issues/12619#issuecomment-449833510
 
 
   Hi, I am getting a very similar error:
   ```
   Process Process-1:
   Traceback (most recent call last):
     File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
       self.run()
     File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
       self._target(*self._args, **self._kwargs)
     File "/usr/local/lib/python3.6/dist-packages/mxnet/gluon/data/dataloader.py", line 178, in worker_loop
       _recursive_fork_recordio(dataset, 0, 1000)
     File "/usr/local/lib/python3.6/dist-packages/mxnet/gluon/data/dataloader.py", line 173, in _recursive_fork_recordio
       _recursive_fork_recordio(v, depth + 1, max_depth)
     File "/usr/local/lib/python3.6/dist-packages/mxnet/gluon/data/dataloader.py", line 173, in _recursive_fork_recordio
       _recursive_fork_recordio(v, depth + 1, max_depth)
     File "/usr/local/lib/python3.6/dist-packages/mxnet/gluon/data/dataloader.py", line 173, in _recursive_fork_recordio
       _recursive_fork_recordio(v, depth + 1, max_depth)
     [Previous line repeated 970 more times]
     File "/usr/local/lib/python3.6/dist-packages/mxnet/gluon/data/dataloader.py", line 166, in _recursive_fork_recordio
       if depth >= max_depth:
   RecursionError: maximum recursion depth exceeded in comparison
   ```
   I am using the latest `cu90mkl` docker (mxnet version 1.3.1). Unfortunately, I can't provide you with the exact code, because of legal reasons.
   
   I have a custom class, that inherits from `mxnet.gluon.data.Dataset`. During the call to `__getitiem__` a bunch of transforms are called. To speed this up, I've tried wrapping the transforms in a `mxnet.gluon.data.vision.transforms.Compose`, which broke the `DataLoader`.
   
   Just applying the transforms sequentially works fine, but Composing them results in a RecursionError.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services