[GitHub] [incubator-mxnet] sbebo commented on issue #13875: importing mxnet causing subprocess to crash

[GitBox <gi...@apache.org>]

sbebo commented on issue #13875: importing mxnet causing subprocess to crash
URL: https://github.com/apache/incubator-mxnet/issues/13875#issuecomment-534190881
 
 
   Hi all, 
   this bug keeps biting us. This is easily reproducible, meaning that it occurs randomly but with pretty high frequency, always within a few hundred attempts, but non deterministic.
   The code I'm using (essentially the same as above):
   
   ```python
   import mxnet
   import subprocess
   
   for i in range(1000):
       if not i%100: print(i)
       try:
           ret = subprocess.call(["ls","/tmp"], stdout=subprocess.PIPE)
       except Exception as e:
           print(i, e)
           exit()
   
   ```
   
   I managed to isolate some requirements to recreate a conda environment where this issue occurs.
   This is obtained with conda + pip as follows (I have conda 4.7.12):
   
   ```bash
   conda create -n mxnet-test --file env_conda.txt
   conda activate mxnet-test
   #make sure we're using the pip in the env
   echo $(which pip)
   pip install -r env_pip.txt
   ```
   
   where the content of the files is:
   ```bash
   env_conda.txt:
   mkl=2019.0=118
   numpy=1.16.4=py36h99e49ec_0
   env_pip.txt:
   mxnet-cu80mkl==1.5.0
   ```
   
   and this is the result of `conda list -e`
   ```
   # platform: linux-64
   _libgcc_mutex=0.1=main
   blas=1.0=openblas
   ca-certificates=2019.5.15=1
   certifi=2019.9.11=py36_0
   chardet=3.0.4=pypi_0
   idna=2.8=pypi_0
   intel-openmp=2019.4=243
   libedit=3.1.20181209=hc058e9b_0
   libffi=3.2.1=hd88cf55_4
   libgcc-ng=9.1.0=hdf63c60_0
   libgfortran-ng=7.3.0=hdf63c60_0
   libopenblas=0.3.6=h5a2b251_1
   libstdcxx-ng=9.1.0=hdf63c60_0
   mkl=2019.0=118
   mxnet-cu80mkl=1.5.0=pypi_0
   ncurses=6.1=he6710b0_1
   numpy=1.16.4=py36h99e49ec_0
   numpy-base=1.16.4=py36h2f8d375_0
   openssl=1.1.1d=h7b6447c_1
   pip=19.2.2=py36_0
   python=3.6.9=h265db76_0
   python-graphviz=0.8.4=pypi_0
   readline=7.0=h7b6447c_5
   requests=2.22.0=pypi_0
   setuptools=41.0.1=py36_0
   sqlite=3.29.0=h7b6447c_0
   tk=8.6.8=hbc83047_0
   urllib3=1.25.5=pypi_0
   wheel=0.33.4=py36_0
   xz=5.2.4=h14c3975_4
   zlib=1.2.11=h7b6447c_3
   ```
   
   
   **Note** : this is non-deterministic also at "build-time", in the sense that, creating environments with _exactly the same requirements and exactly the same installed libraries_, you can randomly end up with an environment where the issue **does not occur**.
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services