Six tests. Real local runs. Find out what each model can do.
Can it finish a task in a real terminal?
GB10 · 128GB
The paper separates execution, coherence and verification failures. A task can fail because the environment or tools break, because the agent loses track of the goal, or because it fails to check its work.
Terminal-Bench research ↗Can it fix an issue in an existing codebase?
GB10 · 128GB
The failure analysis distinguishes incorrect solutions, syntax errors, wrong files, instruction following, tool use, context limits and loops. The diagnosis is richer than a single repository-fix score.
SWE-bench Pro paper ↗Can it turn a problem into working code?
GB10 · 128GB
Time-indexed programming problems support generation, repair, execution and prediction tests. Version, time window and scenario matter when interpreting a result.
LiveCodeBench paper ↗Can it reason through difficult science?
GB10 · 128GB
Expert-written biology, chemistry and physics questions measure difficult scientific question answering. They do not establish practical experimental or research competence.
GPQA paper ↗Can it actually finish the office workflow?
Will it follow the precise instructions?
GB10 · 128GB
The benchmark tests generalization to 58 unfamiliar precise constraints. Strict and loose criteria answer different questions and must be labeled separately.
IFBench paper ↗