You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/04/18 13:38:41 UTC
[GitHub] [incubator-mxnet] nickguletskii opened a new pull request #18097:
Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
nickguletskii opened a new pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
URL: https://github.com/apache/incubator-mxnet/pull/18097
## Description ##
This pull request changes the CentOS CI jobs to run with `LC_NUMERIC` set to `en_DK.UTF8`. `en_DK.UTF8` is a locale that uses `,` as the decimal separator. This should weed out any bugs similar to #16134, #17140 and #18079. A partial fix for v1.x is available in #17177. Migrating operators and other API calls to the new FFI in MXNet 2.0 should resolve most locale-related issues related to API calls.
## Checklist ##
### Essentials ###
Please feel free to remove inapplicable items for your PR.
- [ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant [JIRA issue](https://issues.apache.org/jira/projects/MXNET/issues) created (except PRs with tiny changes)
- [ ] Changes are complete (i.e. I finished coding on this PR)
- [ ] All changes have test coverage:
- Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
- Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
- Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
- [ ] Code is well-documented:
- For user-facing API changes, API doc string has been updated.
- For new C++ functions in header files, their functionalities and arguments are documented.
- For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
- Check the API doc at https://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
- [ ] To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change
### Changes ###
- [ ] Feature1, tests, (and when applicable, API doc)
- [ ] Feature2, tests, (and when applicable, API doc)
## Comments ##
- If this change is a backward incompatible change, why must this change be made.
- Interesting edge cases to note here
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] mxnet-bot commented on issue #18097: Change
LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
mxnet-bot commented on issue #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-615873573
Jenkins CI successfully triggered : [centos-cpu, centos-gpu]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] nickguletskii commented on issue #18097: Change
LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
nickguletskii commented on issue #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-615873557
@mxnet-bot run ci [centos-cpu, centos-gpu]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] mxnet-bot commented on issue #18097: Change
LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
mxnet-bot commented on issue #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-615873466
Hey @nickguletskii , Thanks for submitting the PR
All tests are already queued to run once. If tests fail, you can trigger one or more tests again with the following commands:
- To trigger all jobs: @mxnet-bot run ci [all]
- To trigger specific jobs: @mxnet-bot run ci [job1, job2]
***
**CI supported jobs**: [unix-gpu, centos-gpu, clang, unix-cpu, sanity, windows-gpu, miscellaneous, centos-cpu, website, edge, windows-cpu]
***
_Note_:
Only following 3 categories can trigger CI :PR Author, MXNet Committer, Jenkins Admin.
All CI tests must pass before the PR can be merged.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] nickguletskii commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
nickguletskii commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-619285123
@leezu Thank you, I've rewritten this PR to utilize pytest's conftests.py and updated the CentOS dockerfile accordingly.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu commented on issue #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu commented on issue #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-616256378
@nickguletskii it should be easier to address the code duplication problem once https://github.com/apache/incubator-mxnet/pull/18025 is merged. I suggest you wait until it's merged.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] nickguletskii commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
nickguletskii commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-622938136
@leezu It's actually even easier than that. It's sufficient to set the `LC_NUMERIC` environment variable before running pytest.
However, I don't think that fixing these issues is in scope of this PR. As I've already mentioned in the PR that introduces a hack to fix at least some of these issues (#17177), a permanent solution is to port all old operators to the new FFI.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-618774388
@nickguletskii the pytest PR is merged now. I also consolidated the CentOS dockerfiles into `ci/docker/Dockerfile.build.centos7`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-623008900
@nickguletskii yes, the scope of this PR doesn't need to be "fix all the issues" ;) But for the PR to be merged, you need to find a way for it to pass the CI. One idea is to add a `@pytest.mark.skipif(running on centos)` decorator around the tests invoking broken behavior. Then the PR will pass the CI and can be merged. At the same time @yzhliu and other contributors will have more data on prioritizing which operators to port to the new FFI.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-620323711
@nickguletskii do you know how to reproduce the CI runs locally? For the one you're interested in, just run
```
git clean -ffxd; python ci/build.py --platform centos7_cpu /work/runtime_functions.sh build_centos7_cpu
python ci/build.py --platform centos7_cpu /work/runtime_functions.sh unittest_centos7_cpu
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu edited a comment on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu edited a comment on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-619304261
42 failed tests on centos-cpu. Seems there are still quite a few locale-unsafe parts
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] marcoabreu commented on issue #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
marcoabreu commented on issue #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-616256038
Is there some other method than inserting it at the top of every test file? That's a lot of copy&paste.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] nickguletskii commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
nickguletskii commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-624239333
Hmm, it seems that something has changed in how the CentOS image is built since the last CI run. The required locale doesn't seem to be available anymore. I will try experimenting with the Docker image locally once I find some free time.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-619304261
42 failed tests on centos-cpu
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] nickguletskii commented on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
nickguletskii commented on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-626120328
@leezu Should be ready for review now. Sorry for the delay and thanks for the advice!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] leezu edited a comment on pull request #18097: Change LC_NUMERIC for CentOS CI jobs to verify locale invariance
Posted by GitBox <gi...@apache.org>.
leezu edited a comment on pull request #18097:
URL: https://github.com/apache/incubator-mxnet/pull/18097#issuecomment-623008900
@nickguletskii yes, the scope of this PR doesn't need to be "fix all the issues" ;) But for the PR to be merged, you need to find a way for it to pass the CI. One idea is to use the [pytest xfail features](https://docs.pytest.org/en/latest/skipping.html), marking the tests invoking broken behavior. You'd want to set the condition on when the test is xfail based on the operating system (centos) or the environment variable in question. Reference https://docs.pytest.org/en/latest/reference.html#pytest-mark-xfail-ref
Then the PR will pass the CI and can be merged. At the same time @yzhliu and other contributors will have more data on prioritizing which operators to port to the new FFI.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org