You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@magpie.apache.org by "ahmadalguydi (via GitHub)" <gi...@apache.org> on 2026/07/29 13:52:45 UTC

[PR] docs: explain grading-schema overrides [magpie]

ahmadalguydi opened a new pull request, #1035:
URL: https://github.com/apache/magpie/pull/1035

   Closes #951
   
   ## Summary
   - document the per-fixture grading-schema.json override in the release-prepare eval README
   - link the real step-1-plan/fixtures/grading-schema.json example
   - clarify that grading-schema.json controls exact-versus-rubric prose comparison while assertions.json supplies deterministic predicates
   
   ## Validation
   - git diff --check
   - PYTHONPATH=tools/skill-evals/src python -m pytest tools/skill-evals/tests/test_runner.py -k grading_schema -q (5 targeted tests passed; the CLI-grader case is excluded)
   - the Windows CLI-grader test remains blocked by its existing shell-command fixture (WinError 2)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@magpie.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] docs: explain grading-schema overrides [magpie]

Posted by "ahmadalguydi (via GitHub)" <gi...@apache.org>.
ahmadalguydi closed pull request #1035: docs: explain grading-schema overrides
URL: https://github.com/apache/magpie/pull/1035


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@magpie.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org