[GitHub] [incubator-mxnet] aaronmarkham opened a new pull request #16512: detect number of procs during sphinx build

[GitBox <gi...@apache.org>]

aaronmarkham opened a new pull request #16512: detect number of procs during sphinx build
URL: https://github.com/apache/incubator-mxnet/pull/16512
 
 
   ## Description ##
   I ran into a build issue when making the python docs on an instance with 16 processors. The makefile for sphinx was hardcoded to 32 which I guess was fine for CI.
   
   The error was like this:
   
   ```
   /work/mxnet/docs/python_docs/python/build/tutorials/packages/gluon/training/fit_api_tutorial.ipynb:395: WARNING: File not found: 'tutorials/packages/gluon/blocks/save_load_params.html#saving-model-parameters-to-file'
   
   Sphinx parallel build error:
   IndexError: list index out of range
   ```
   
   I turned off parallel builds with Sphinx and it worked, then switched to this new code that detects the number of processors in the Makefile and that worked.
   
   ## Testing
   1. Clone the repo.
   2. [Install Docker and Docker for python and make it so docker doesn't need sudo to run](https://github.com/apache/incubator-mxnet/blob/master/ci/README.md).
   3. Run the following two commands to build the mxnet binary, then build the python docs.
   
   ```
   ci/build.py --docker-registry mxnetci --platform ubuntu_cpu_lite /work/runtime_functions.sh build_ubuntu_cpu_docs
   ci/build.py --docker-registry mxnetci --platform ubuntu_cpu_python /work/runtime_functions.sh build_python_docs
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services