[GitHub] erenavsarogullari opened a new issue #2865: [Integration Test Pipeline] Add Quarantine List Support

[GitBox <gi...@apache.org>]

erenavsarogullari opened a new issue #2865: [Integration Test Pipeline] Add Quarantine List Support
URL: https://github.com/apache/incubator-heron/issues/2865
 
 
   Integration Test Pipeline looks having a couple of flaky tests recently. For the long-term, in the light of incoming features and their new integration-tests, Integration Test Pipeline' s stabilization will be more important.
   
   - `quarantine-list` feature can be useful to manage/disable flaky integration-tests without touching source-code (`~/integration_test/src/python/test_runner/resources/test.json`). Test can be quarantined until proper-fix by getting agreement in channel so will not block build pipeline and related build (`~2h`) due to unstable behavior.
   - On the other hand, after it is quarantined, it can still continue to run without breaking the build (even if it fails) so related flaky test patch can be monitored and verified.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services