[GitHub] [pulsar] lhotari commented on pull request #10148: [CI] Move flaky tests that fail very often to "quarantine" test group

[GitBox <gi...@apache.org>]

lhotari commented on pull request #10148:
URL: https://github.com/apache/pulsar/pull/10148#issuecomment-813962924


   > @lhotari How do we get the test result of the "quarantine" test group?
   
   There's no special reporting since we don't have a proper solution for reporting test reports.
   A warning will get added to the build summary page if one of tests in the "quarantine" group fails.
   This uses the GitHub Actions built-in feature. When there is "::warning::" as the prefix in console output, GitHub Actions adds a warning to the build summary page.
   
   One would have to check the logs to see what quarantined tests failed. The reporting can be improved later. Currently the CI pipeline is almost completely clogged because a few flaky tests make most builds to fail.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org