LocalsOnlyevaluationsHow to read this
← Model evidence

LocalsOnly · measured2026-09-12

GPQA Diamond

Diamond · version 1.0 · 198 tasks. Compare only matched task sets and protocols.

Qwen 3.8 Flash-Next · UD-IQ3_XXS · GB10 · 128GB · llama.cpp

● Tested by LocalsOnly
WALL-CLOCK TIME32.7 h
INPUT TOKENS2,078,003

Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.

Reported score88.4%175 of 198 tasks passed
Throughput26.5 t/s

Tokens per second · see measurement basis

Concurrency1

As recorded on this receipt

0 infrastructure outcomes are recorded. Failure counts may overlap with task outcomes.
Run configuration & provenance +
Context
65,536
Temperature
Not recorded
Wall time
1961.3 minutes
Weight file
Provider-managed / not reported
Revision
Not reported
Reasoning
Not reported
Agent version
Not reported
Output token limit
Not reported
Dataset revision
harbor gpqa-diamond@1.0 (198 tasks)
Harness host
Not reported
Model host
Asus gx10-e789 · :8081
Input tokens
2,078,003
Output tokens
1,505,772
Cached input tokens
1,509,881
Agent turn / step limit
50
Concurrency
1
Weight file size
Not reported

Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.

terminus-2

Run ID: measured-spark-1x-unsloth-ud-iq3_xxs-gpqa-diamond-1.0-2026-09-12
Tasks

Task explorer

Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.

198 task records
175 Passed23 Not passed

All 198 recorded tasks, before filters or pagination. 25 of 198 matching tasks shown below. Recorded issues can also occur on scored tasks.

PassedTask ID 0+

Task ID: 0
Recorded name: 0

Reward: 1

Tokens in / out: 3,135 / 1,253

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 1+

Task ID: 1
Recorded name: 1

Reward: 1

Tokens in / out: 3,044 / 3,082

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 2+

Task ID: 2
Recorded name: 2

Reward: 1

Tokens in / out: 10,016 / 2,405

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3+

Task ID: 3
Recorded name: 3

Reward: 1

Tokens in / out: 3,739 / 1,283

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 4+

Task ID: 4
Recorded name: 4

Reward: 1

Tokens in / out: 18,469 / 3,203

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 5+

Task ID: 5
Recorded name: 5

Reward: 1

Tokens in / out: 15,891 / 5,782

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 6+

Task ID: 6
Recorded name: 6

Reward: 1

Tokens in / out: 5,412 / 1,833

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 7+

Task ID: 7
Recorded name: 7

Reward: 1

Tokens in / out: 6,224 / 5,290

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 8+

Task ID: 8
Recorded name: 8

Reward: 1

Tokens in / out: 3,234 / 18,993

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 9+

Task ID: 9
Recorded name: 9

Reward: 1

Tokens in / out: 5,815 / 2,216

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 11+

Task ID: 11
Recorded name: 11

Reward: 1

Tokens in / out: 3,179 / 1,140

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 12+

Task ID: 12
Recorded name: 12

Reward: 1

Tokens in / out: 45,632 / 59,122

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 13+

Task ID: 13
Recorded name: 13

Reward: 1

Tokens in / out: 2,930 / 10,163

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 14+

Task ID: 14
Recorded name: 14

Reward: 1

Tokens in / out: 3,262 / 1,236

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 15+

Task ID: 15
Recorded name: 15

Reward: 1

Tokens in / out: 3,107 / 19,731

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 16+

Task ID: 16
Recorded name: 16

Reward: 1

Tokens in / out: 3,013 / 1,012

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 18+

Task ID: 18
Recorded name: 18

Reward: 1

Tokens in / out: 3,706 / 10,683

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 19+

Task ID: 19
Recorded name: 19

Reward: 1

Tokens in / out: 4,861 / 1,521

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 20+

Task ID: 20
Recorded name: 20

Reward: 1

Tokens in / out: 3,257 / 1,847

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 21+

Task ID: 21
Recorded name: 21

Reward: 1

Tokens in / out: 10,646 / 11,127

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 22+

Task ID: 22
Recorded name: 22

Reward: 1

Tokens in / out: 3,881 / 8,724

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 23+

Task ID: 23
Recorded name: 23

Reward: 1

Tokens in / out: 3,466 / 9,778

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 24+

Task ID: 24
Recorded name: 24

Reward: 1

Tokens in / out: 3,463 / 11,471

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 25+

Task ID: 25
Recorded name: 25

Reward: 1

Tokens in / out: 3,503 / 12,266

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 26+

Task ID: 26
Recorded name: 26

Reward: 1

Tokens in / out: 4,015 / 1,452

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
Showing 25 of 198 tasks