[PR] feat(release-audit-report): add structured audit-record schema and schema-violation eval [magpie]

["justinmclean (via GitHub)" <gi...@apache.org>]

justinmclean opened a new pull request, #722:
URL: https://github.com/apache/magpie/pull/722

   ## Summary
   
   Add `skills/release-audit-report/audit-record-schema.md` — a canonical definition of required vs optional audit-record fields, the schema-violation reporting contract, and the privacy boundary for each field.  Update `release-audit-report/SKILL.md` to reference the schema in Step 2, add `schema_violations` to the Step 2 JSON output contract, and extend the Step 4 hand-back artefact to surface violations to the RM.
   
   Extend the eval suite (step-2-assemble-record) with a `has_schema_violations_consistent` judge assertion across all cases, update the output-spec to document the new field, add `schema_violations` to the three existing expected.json files, and add
   `case-4-all-required-missing` — a fixture that proves the skill reports all nine required-field violations when none of the lifecycle evidence was recorded on the planning issue.
   
   Generated-by: Claude (Opus 4.7)
   
   ## Type of change
   
   - [X] Skill change (`.claude/skills/<name>/`) — eval fixtures updated below
   - [ ] Tool / bridge contract (`tools/<system>/*.md`)
   - [ ] Python package (`tools/*/` with `pyproject.toml`)
   - [ ] Groovy reference impl
   - [ ] Cross-cutting (RFC, AGENTS.md, sandbox, privacy-LLM)
   - [ ] Documentation (`docs/`, `README.md`, `CONTRIBUTING.md`)
   - [ ] Project template (`projects/_template/`)
   - [ ] CI / dev loop (`prek`, workflows, validators)
   - [ ] Other:
   
   ## Test plan
   
   - [X] `prek run --all-files` passes
   - [ ] For Python packages touched: `uv run pytest` / `ruff check` / `mypy` passes
   - [ ] For Groovy bridges touched: command-line invocation tested end-to-end
   - [X] For skill changes: eval suite passes for the affected skill
         (`PYTHONPATH=tools/skill-evals/src python3 -m skill_evals.runner tools/skill-evals/evals/<skill>/`)
   - [ ] For skill *behaviour* changes: a new or updated eval fixture is included in this PR
         (a regression test for the bug fixed / the behaviour added — see CONTRIBUTING.md)
   - [ ] Other:
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@magpie.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] feat(release-audit-report): add structured audit-record schema and schema-violation eval [magpie]

["potiuk (via GitHub)" <gi...@apache.org>]

potiuk merged PR #722:
URL: https://github.com/apache/magpie/pull/722


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@magpie.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org