Rails Foundation

Rails programmers kept saying that Rails and AI pair well together, that Convention over Configuration makes Rails token-efficient, that models tend to write good Rails. The Rails Foundation wanted more than anecdotes, so it commissioned Evil Martians to measure it. We designed and built the harness and task corpus, ran the evals, and published the results. The harness is lemans, now open source: it runs agents in a sandbox they can’t escape, and grades them with tests they can’t tamper with.