Backtestsvuerun-20261005-124535

vuejs/core

Vue.js, the progressive JavaScript framework (core packages).

This run · 5 Oct 2026 · run-20261005-124535

83%judged better than the merged fix

25 of 30 tickets. sudo-solver 0.4.1.

25 better0 par4 worse1 error

Runs on this sample

Click a run to see its tickets
21 Oct 2026run-20261021-133314 24 better0 par2 tie4 worse0 error Added a test-writing agent to test that the fix fixes the bug; added 4 parallelized judges; cut the setup agent's prompt from 200+ lines to 94 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
13 Oct 2026run-20261013-093701 24 better0 par6 worse0 error sudo-solver 0.5.1. Test suite changes: the tests related to each changed file run on the code before and after the patch, and a file no rule maps gets up to 10 nearby tests instead of none. No generated acceptance test 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
9 Oct 2026run-20261009-161443 24 better0 par5 worse1 error Tests now run only the tests related to each change, on the code before and after the patch, plus a generated acceptance test. Ticket 15217 was rerun after a harness fix. 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
7 Oct 2026run-20261007-145226 25 better0 par5 worse0 error 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
5 Oct 2026run-20261005-155915 25 better0 par5 worse0 error sudo-solver 0.5.1 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
5 Oct 2026run-20261005-124535 25 better0 par4 worse1 error sudo-solver 0.4.1 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
3 Oct 2026run-20261003-231210 27 better0 par2 worse1 error Foreman lane on sudo-solver 0.4.0, same sample as the first vuejs/core run 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
2 Oct 2026run-20261002-115633 18 better0 par10 worse2 error used the foreman lane (software factory) 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite
30 Sep 2026run-20261001-022054 13 better0 par15 worse2 error First vuejs/core run 30 tickets · permalink
IssueTitleVerdictLines ours / mergedTest suite

The two errors are tickets lost before the agent ran: their base commits pinned a pnpm release that refuses to install, and setting up a working environment for them timed out. Every judged ticket passed verification and audited clean.