You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/01/08 23:31:15 UTC
[GitHub] [incubator-mxnet] samskalicky opened a new issue #17252: updated
NCCL version breaks nightly pip wheel builds
samskalicky opened a new issue #17252: updated NCCL version breaks nightly pip wheel builds
URL: https://github.com/apache/incubator-mxnet/issues/17252
## Description
nightly pip wheel builds were building successfully until December 30th. On December 31st the builds started failing for these build flavors:
cu90
cu100
cu101
cu90mkl
cu100mkl
cu101mkl
### Error Message
All builds failed with the same error message:
```
/usr/bin/ld: /root/pip_build/mxnet-build/staticdeps/usr/lib/x86_64-linux-gnu/libnccl.a(init.o): unrecognized relocation (0x2a) in section `.text'
/usr/bin/ld: final link failed: Bad value
collect2: error: ld returned 1 exit status
make: *** [lib/libmxnet.so] Error 1
make: *** Waiting for unfinished jobs....
/usr/bin/ld: /root/pip_build/mxnet-build/staticdeps/usr/lib/x86_64-linux-gnu/libnccl.a(transport.o): unrecognized relocation (0x2a) in section `.text.startup'
/usr/bin/ld: final link failed: Bad value
collect2: error: ld returned 1 exit status
make: *** [bin/im2rec] Error 1
```
## To Reproduce
Build using the docker container used in the CI:
mxnetci/publish.ubuntu1404_cpu
```
./tools/staticbuild/build.sh $mxnet_variant pip
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] szha commented on issue #17252: updated NCCL
version breaks nightly pip wheel builds
Posted by GitBox <gi...@apache.org>.
szha commented on issue #17252: updated NCCL version breaks nightly pip wheel builds
URL: https://github.com/apache/incubator-mxnet/issues/17252#issuecomment-575966017
fixed in #17259
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] samskalicky commented on issue #17252: updated
NCCL version breaks nightly pip wheel builds
Posted by GitBox <gi...@apache.org>.
samskalicky commented on issue #17252: updated NCCL version breaks nightly pip wheel builds
URL: https://github.com/apache/incubator-mxnet/issues/17252#issuecomment-572308869
@mxnet-label-bot update [Build]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] szha edited a comment on issue #17252: updated
NCCL version breaks nightly pip wheel builds
Posted by GitBox <gi...@apache.org>.
szha edited a comment on issue #17252: updated NCCL version breaks nightly pip wheel builds
URL: https://github.com/apache/incubator-mxnet/issues/17252#issuecomment-572314843
working on it in https://github.com/szha/mxnet/tree/fix_cd_s3 (https://github.com/szha/mxnet/commit/f2035bf4b2d282e8fd5344e4afddcc6f21cd7fc1)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] szha commented on issue #17252: updated NCCL
version breaks nightly pip wheel builds
Posted by GitBox <gi...@apache.org>.
szha commented on issue #17252: updated NCCL version breaks nightly pip wheel builds
URL: https://github.com/apache/incubator-mxnet/issues/17252#issuecomment-572314843
working on it in https://github.com/szha/mxnet/commit/f2035bf4b2d282e8fd5344e4afddcc6f21cd7fc1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] szha closed issue #17252: updated NCCL version
breaks nightly pip wheel builds
Posted by GitBox <gi...@apache.org>.
szha closed issue #17252: updated NCCL version breaks nightly pip wheel builds
URL: https://github.com/apache/incubator-mxnet/issues/17252
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services