You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by "lizhimins (via GitHub)" <gi...@apache.org> on 2026/05/25 02:55:05 UTC
[PR] [ISSUE #10373] Quarantine flaky tests and add detection plan docs [rocketmq]
lizhimins opened a new pull request, #10374:
URL: https://github.com/apache/rocketmq/pull/10374
## Summary
- Quarantine flaky test methods with `@Ignore` annotations across broker, client, filter, and tieredstore modules
- Add flaky test detection plan documentation (CN + EN) under `docs/cn/`
- Switch `LiteLifecycleManagerTest` to `MockitoJUnitRunner.Silent` to fix unnecessary stubbing error after `@Ignore`
## Motivation
Flaky tests cause intermittent CI failures that erode developer trust in build signals. These methods were identified by running the full test suite 100× across 10 ECS nodes using a three-layer funnel (module → class → method). Methods with ≥1% failure rate are quarantined.
## Test plan
- [ ] Verify CI passes with quarantined tests ignored
- [ ] Confirm no test coverage loss for non-flaky paths
- [ ] Review `@Ignore` annotations include failure rate metadata
🤖 Generated with [Claude Code](https://claude.com/claude-code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [ISSUE #10373] Quarantine flaky tests and add detection plan docs [rocketmq]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #10374:
URL: https://github.com/apache/rocketmq/pull/10374#issuecomment-4531244639
## [Codecov](https://app.codecov.io/gh/apache/rocketmq/pull/10374?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 48.77%. Comparing base ([`7e5d22d`](https://app.codecov.io/gh/apache/rocketmq/commit/7e5d22dff8542dfe7176147970d72a177904675d?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`ef7327d`](https://app.codecov.io/gh/apache/rocketmq/commit/ef7327d283f4ec313324869f55c49ad0caf80a9e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## develop #10374 +/- ##
=============================================
- Coverage 48.98% 48.77% -0.21%
+ Complexity 13482 13421 -61
=============================================
Files 1376 1376
Lines 100539 100539
Branches 12983 12983
=============================================
- Hits 49244 49038 -206
- Misses 45287 45488 +201
- Partials 6008 6013 +5
```
</details>
[:umbrella: View full report in Codecov by Sentry](https://app.codecov.io/gh/apache/rocketmq/pull/10374?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [ISSUE #10373] Quarantine flaky tests and add detection plan docs [rocketmq]
Posted by "RongtongJin (via GitHub)" <gi...@apache.org>.
RongtongJin merged PR #10374:
URL: https://github.com/apache/rocketmq/pull/10374
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org