Benchmark harness for the 38 runnable Martian PRs #127

Closed
opened 2026-10-27 13:35:04 +00:00 by sam · 0 comments
Owner

Reproducible script: blind deep run per PR, independent judge, golden micro-recall and golden-only precision. See docs/prds/pr-review-agent.md.

Notes

Run on the builtin ai-sdk runner with GLM-5.2 for both roles; OpenCode support is not needed (maintainer decision).

Close reason

Closed


Imported from beads archie-core-afbk.2 · GitHub #1201 · type task · priority P1 · created 2026-09-25 · closed 2026-09-26

Reproducible script: blind deep run per PR, independent judge, golden micro-recall and golden-only precision. See docs/prds/pr-review-agent.md. ### Notes Run on the builtin ai-sdk runner with GLM-5.2 for both roles; OpenCode support is not needed (maintainer decision). ### Close reason Closed --- _Imported from beads `archie-core-afbk.2` · GitHub #1201 · type task · priority P1 · created 2026-09-25 · closed 2026-09-26_
sam added the hightask labels 2026-10-27 13:35:04 +00:00
sam self-assigned this 2026-10-27 13:35:04 +00:00
sam closed this issue 2026-10-27 13:35:04 +00:00
sam added a new dependency 2026-10-27 13:41:44 +00:00
sam added a new dependency 2026-11-14 14:45:16 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Reference: sam/archie#127