LocalsOnlyevaluationsHow to read this
← Model evidence

Published reference2026-09-22

AutomationBench · public 600*

Published public evaluation · 600-task set. Task sets and protocols differ. A local sample is not established as a subset of the published public set; scores remain separate.

GPT-6 Sol · Published reference · Published by OpenAI · OpenAI · xhigh

↗ Published result
Published by OpenAI

AutomationBench 1.0.6

Introducing GPT-6 Sol and Luna
Reported score33.2%
Throughput

Tokens per second · see measurement basis

Concurrency

As recorded on this receipt

Published reference. This is a source-reported result, not a test run by this lab. Launch-page table: GPT-6 Sol at xhigh effort, 33.2% on AutomationBench 1.0.6. Not the LocalsOnly local-300 office sample. Terminal-Bench 2.1 and SWE-bench Verified are not published for Sol on this page. https://openai.com/index/introducing-gpt-6-sol-and-luna/
Run configuration & provenance +
Context
Not recorded
Temperature
Not recorded
Wall time
Not recorded
Weight file
Provider-managed / not reported
Revision
Not reported
Reasoning
Not reported
Agent version
Not reported
Output token limit
Not reported
Dataset revision
Not reported
Harness host
Not reported
Model host
Published reference
Input tokens
Not reported
Output tokens
Not reported
Cached input tokens
Not reported
Agent turn / step limit
Not reported
Concurrency
Not reported
Weight file size
Not reported

Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.

OpenAI · GPT-6 Sol · xhigh · AutomationBench 1.0.6. API id gpt-6-sol. Not a LocalsOnly desk run.

Launch-page table: GPT-6 Sol at xhigh effort, 33.2% on AutomationBench 1.0.6. Not the LocalsOnly local-300 office sample. Terminal-Bench 2.1 and SWE-bench Verified are not published for Sol on this page. https://openai.com/index/introducing-gpt-6-sol-and-luna/

Run ID: research-gpt-6-sol-codex-max-published-reference-automationbench-public
Tasks

Task explorer

Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.

0 task records

No task records in this receipt.

The headline or summary is available above. Individual outcomes have not been provided.

Explore test coverage →