Measuring on real project history

Measuring on real project history An architecture diagram generated by Archify. Git replay · SZZ over fix commits · Your machine: Runs on the developer's machine; code leaves it only in the two model calls Git replay SZZ over fix commits Project history · git log and blame · Architecture component Project history git log and blame Review worker · detached process · Your machine: Runs on the developer's machine; code leaves it only in the two model calls Review worker detached process Claude Opus 5.5 · claim checker · Architecture component Claude Opus 5.5 claim checker check one claim · HTTPS read commits and blame · spawn review each commit judge a match · HTTPS Your machine: Runs on the developer's machine; code leaves it only in the two model calls Legend Backend External

The short answer

  • • The git replay labels each commit buggy if a later fix commit changed its lines, runs the same worker on it, and has Opus judge whether any finding names the bug that was fixed

Not shown here

  • • The hooks and delivery, which the replay bypasses by calling the worker directly
  • • Connected but out of scope: Hook entry, Turn log and jobs, Settings, Router, DeepSeek Flash, Project tests

Risks

  • • Git history is a noisy answer key: 'clean' only means no fix commit touched the lines; some confirmed findings on clean commits may be real bugs nobody fixed