Agents on Rails: Stage 3. Can a model build on its own work?

Now that we understand better how agents deal with contained tasks and contained codebases, it’s time to push them a little harder. Stage 3 adds a set of large multi-step tasks that test how well a model can build on its own work over multiple sessions without turning it into a hot mess. We’ve also greatly expanded the variety of apps we test the models on. Finally, we revisited Stages 1 and 2 to combine all three into a single benchmark that answers one question: which model is the best all-...