Agents on Rails: The LLM Benchmark Project

Today we’re sharing the first results of Agents on Rails , a new, ongoing initiative to measure how well today’s leading agentic coding tools (both frontier and open-weight) actually perform on Ruby on Rails codebases. The Rails Foundation commissioned Evil Martians for this project, which will roll out in several stages over the next few weeks. Read more about the project below, check out the leaderboard , or jump right over to the first benchmark report . Why we built this. The use of codin...