Backtestshugo
gohugoio/hugo
Static site generator written in Go.
Latest run · 24 Oct 2026 · run-20261024-162305
90%judged better than the merged fix
27 of 30 tickets. sudo-solver 0.5.1 on the foreman lane, first full hugo run with the judge panel.
Runs on this sample
Click a run to see its tickets24 Oct 2026run-20261024-162305 sudo-solver 0.5.1 on the foreman lane, first full hugo run with the judge panel
The one error is a verdict we threw out, not a crash. Ticket 15228 (upgrading hugo to Go 1.27) was judged better, but the sandbox ran Go 1.27.3, which shipped seven weeks after the real fix. The agent copied in template security fixes that did not exist yet when the maintainer did the work. The harness now runs each ticket on the Go release that was current on the fix date. Two tickets here, 7515 and 15199, were closed by the same commit; future samples keep only one. Every ticket passed verification and audited clean.