ModelScaleby MonoMind AI LabAgentic benchmark
SWE-sweep leaderboard
SWE-sweep: Can Agents Autonomously Find and Fix Bugs?. Every model the catalog carries a published SWE-sweep value for, ranked by that value.
- Printed
- Page
- https://modelscale.dev
About this benchmark
Tests whether coding agents can find and fix multiple bugs across a repository without issue descriptions, while preserving existing behavior. 0 models in the ModelScale catalog have a published value.
When it's a good referenceUse it when choosing a model for multi-step work with tools, where the model acts rather than only answers. Check how the agent was set up before comparing two rows.
CategoryAgentic
MeasureMicro-average percentage of bugs resolved with a repository regression gate
Tasks4,068 reference bugs across 100 repositories in 22 languages
DifficultyRepository-wide bug discovery and repair
No model in the catalog has a published SWE-sweep score.The benchmark is defined by SWE-sweep: Can Agents Autonomously Find and Fix Bugs?, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About SWE-sweep
What the benchmark measures and how its value is published, from the source’s own record.
What is SWE-sweep?
SWE-sweep (SWE-sweep: Can Agents Autonomously Find and Fix Bugs?) is an agentic benchmark published by SWE-sweep: Can Agents Autonomously Find and Fix Bugs. Tests whether coding agents can find and fix multiple bugs across a repository without issue descriptions, while preserving existing behavior. Its evaluation set is described by the source as 4,068 reference bugs across 100 repositories in 22 languages. The source rates its difficulty as repository-wide bug discovery and repair.
How is SWE-sweep scored?
Each model's result is published by SWE-sweep: Can Agents Autonomously Find and Fix Bugs as micro-average percentage of bugs resolved with a repository regression gate. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
About MonoMindmonomind.oneMonoMind is an AI transformation partner for businesses.
We are a digital agency and AI consulting studio. We help companies move from “we should be using AI” to AI that works inside their business and produces results.
What we do
- AI Strategy
- We start with your business, not the technology. We find where AI can reduce cost, save effort, or create new revenue, then build a clear roadmap you can act on.
- Build & Deploy
- We design, build, and launch the websites, platforms, and AI-powered tools in that roadmap. Everything we build is meant to go live and be used.
- Marketing & Growth
- A good product still needs to reach people. We turn your digital presence into a growth channel through content, search, and campaigns built for your audience.
How we work
- One team, start to finish. The people who shape your strategy also deliver it. Nothing gets lost between planning and launch.
- Priced by value. We charge based on the outcome we deliver, not the effort it takes. Our incentive is your result.
- Local understanding. We know the languages, platforms, and business culture of the markets we serve, so our work fits how your customers actually behave.
Our belief
AI should make a business simpler and stronger, not more complicated. Our name reflects that: Mono for focus, Mind for intelligence. We focus on the few things that matter most, and we use AI to get them done well.
Let’s talk about what AI can do for your business.
daren@monomind.one · https://monomind.one
ModelScaleby MonoMind AI LabEvidence for practical AI runtime and cost decisions.
Every figure in this document comes from a cited upstream source and carries the date it was read. A value no source published is shown as unavailable, never as zero. The live page is updated as the sources change.
- Live page
- https://modelscale.dev
- Sources
- https://modelscale.dev/sources
- Printed
© 2026 MonoMind AI Lab · modelscale.dev