[GitHub] [incubator-mxnet] roywei opened a new issue #15140: [Feature Request][CI] Run nightly tutorial jobs for tutorial PRs

[GitBox <gi...@apache.org>]

roywei opened a new issue #15140: [Feature Request][CI] Run nightly tutorial jobs for tutorial PRs
URL: https://github.com/apache/incubator-mxnet/issues/15140
 
 
   Currently tutorials tests are only ran in nightly tests http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/NightlyTestsForBinaries/activity
   All PRs to add/modify tutorials are not validated and often cause nightly tutorial to fail.
   As a result nightly tests have been failing for a every long time.
   
   Most often reason for it to fail is:
   1. Forget to add tutorials dependencies (third party libraries) in CI docker install
   2. Warnings generated during notebook execution. (considered as failing)
   3. some tutorial need more shared memory in CI job.
   
   Tutorials contributors may not be familiar witht he above 3 points, and these won't fail when they test their tutorial locally in Jupyter notebook.
   
   Suggest to:
   1. Add documentation in tutorial contribution.
   2. Enforece tutorial related PRs to run test tutorial onece before merging.
   
   This will prevent people going back and fix nightly test failure on tutorials, which may take a long time.
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services