You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Lewis John McGibbney (Jira)" <ji...@apache.org> on 2026/04/16 00:00:00 UTC
[jira] [Created] (NUTCH-3172) Introduce PIT Mutation Testing into the CI Pipeline
Lewis John McGibbney created NUTCH-3172:
-------------------------------------------
Summary: Introduce PIT Mutation Testing into the CI Pipeline
Key: NUTCH-3172
URL: https://issues.apache.org/jira/browse/NUTCH-3172
Project: Nutch
Issue Type: Improvement
Components: ci/cd, test
Reporter: Lewis John McGibbney
Integrate [PIT mutation testing|https://pitest.org/] into Nutch's GitHub Actions CI pipeline to measure true test effectiveness beyond what line/branch coverage (JaCoCo) currently reports.
Nutch already collects JaCoCo code coverage via the jacoco-report Ant target, and this data is forwarded to SonarCloud for quality gate analysis (.github/workflows/sonarcloud.yml). However, line coverage is a weak proxy for test quality — a test suite can achieve 80 % branch coverage while still failing to detect trivial logic errors (off-by-one, flipped conditions, removed null-checks, etc.).
Mutation testing addresses this by systematically introducing small, realistic code faults ("mutants") and verifying that at least one test fails as a result. The percentage of mutants killed is the mutation score — a far stronger indicator of test suite effectiveness than coverage alone.
PIT (PITest) is the de-facto standard mutation testing tool for Java.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)