[GitHub] [incubator-mxnet] aaronmarkham opened a new issue #16306: [Julia CI pipeline] reduce complexity and deps

[GitBox <gi...@apache.org>]

aaronmarkham opened a new issue #16306: [Julia CI pipeline] reduce complexity and deps
URL: https://github.com/apache/incubator-mxnet/issues/16306
 
 
   ## Description
   
   For the other language bindings, I was able to reduce the dependencies down quite a lot by using the "[lite](https://github.com/apache/incubator-mxnet/blob/master/ci/docker/Dockerfile.build.ubuntu_cpu_lite)" dockerfile as a starting point and layer on the minimum dependencies, but for some reason, every time I tried that with Julia I'd end up with a broken build when Julia tried to load the MXNet binary. So currently it uses what's essentially the fully-loaded `ubuntu_cpu` dockerfile, which will install things like clojure and scala, when it really doesn't need that.
   
   The issue here is that if anything goes wrong with the fully-loaded build pipeline, the Julia build will break and snowball into breaking the rest of the website publishing.
   For example, we're experience an [issue with MKL right now](https://github.com/apache/incubator-mxnet/issues/16300), and since Julia docs installs that too, Julia docs breaks, and brings the whole website with it.
   
   ## Expected results
   I want to see the [julia dockerfile](https://github.com/apache/incubator-mxnet/blob/master/ci/docker/Dockerfile.build.ubuntu_cpu_julia) slimmed down to the bare minimum dependencies, to reduce backsplash from unrelated problems.
   
   ## How to reproduce
   You can run into the build problem following these steps.
   
   1. Run a "lite" binary build (instead of the fully-loaded one).
   ```
   ci/build.py --docker-registry mxnetci --platform ubuntu_cpu_lite /work/runtime_functions.sh build_ubuntu_cpu_docs
   ```
   
   2. Run the Julia docs build:
   ```
   ci/build.py --docker-registry mxnetci --platform ubuntu_cpu_julia /work/runtime_functions.sh build_julia_docs
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services