Backtestsvuerun-20261013-093701
vuejs/core
Vue.js, the progressive JavaScript framework (core packages).
This run · 13 Oct 2026 · run-20261013-093701
80%judged better than the merged fix
24 of 30 tickets. sudo-solver 0.5.1. Test suite changes: the tests related to each changed file run on the code before and after the patch, and a file no rule maps gets up to 10 nearby tests instead of none. No generated acceptance test.
24 better0 par6 worse0 error
Runs on this sample
Click a run to see its tickets21 Oct 2026run-20261021-133314 Added a test-writing agent to test that the fix fixes the bug; added 4 parallelized judges; cut the setup agent's prompt from 200+ lines to 94
13 Oct 2026run-20261013-093701 sudo-solver 0.5.1. Test suite changes: the tests related to each changed file run on the code before and after the patch, and a file no rule maps gets up to 10 nearby tests instead of none. No generated acceptance test
9 Oct 2026run-20261009-161443 Tests now run only the tests related to each change, on the code before and after the patch, plus a generated acceptance test. Ticket 15217 was rerun after a harness fix.
7 Oct 2026run-20261007-145226
5 Oct 2026run-20261005-155915 sudo-solver 0.5.1
5 Oct 2026run-20261005-124535 sudo-solver 0.4.1
3 Oct 2026run-20261003-231210 Foreman lane on sudo-solver 0.4.0, same sample as the first vuejs/core run
2 Oct 2026run-20261002-115633 used the foreman lane (software factory)
30 Sep 2026run-20261001-022054 First vuejs/core run
The two errors are tickets lost before the agent ran: their base commits pinned a pnpm release that refuses to install, and setting up a working environment for them timed out. Every judged ticket passed verification and audited clean.