LocalsOnly · measured2026-09-04
GPQA Diamond
Diamond · version 1.0 · 198 tasks. Compare only matched task sets and protocols.
Qwen 3.8 27B · UD-Q4_K_XL · GB10 · 128GB · llama.cpp
● Tested by LocalsOnlyRecorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.
Tokens per second · see measurement basis
As recorded on this receipt
Reported category outcomes
Each category keeps its own recorded denominator. Some categories exclude unscored trials. Mean reward, when present, is partial credit.
Run configuration & provenance +
- Context
- Not recorded
- Temperature
- Not recorded
- Wall time
- 937.0 minutes
- Weight file
- Qwen3.8-27B-UD-Q4_K_XL.gguf ↗
- Revision
- 4ca720788d1e01f1bff70c033e0d0028fd02e502
- Reasoning
- Not reported
- Agent version
- Not reported
- Output token limit
- Not reported
- Dataset revision
- harbor gpqa-diamond@1.0 (198 tasks)
- Harness host
- Not reported
- Model host
- ASUS GX10 · 128GB
- Input tokens
- 2,672,783
- Output tokens
- 439,582
- Cached input tokens
- 2,188,116
- Agent turn / step limit
- 50
- Concurrency
- 1
- Weight file size
- 17.56 GB
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
terminus-2
Run ID: measured-spark-1x-unsloth-ud-q4_k_xl-gpqa-diamond-1.0-2026-09-04Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
All 198 recorded tasks, before filters or pagination. 25 of 198 matching tasks shown below. Recorded issues can also occur on scored tasks.
PassedTask ID 0+
Task ID: 0
Recorded name: 0
Reward: 1
Tokens in / out: 2,689 / 904
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 1+
Task ID: 1
Recorded name: 1
Reward: 1
Tokens in / out: 2,522 / 544
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 2+
Task ID: 2
Recorded name: 2
Reward: 1
Tokens in / out: 2,738 / 656
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 3+
Task ID: 3
Recorded name: 3
Reward: 1
Tokens in / out: 4,917 / 1,421
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 4+
Task ID: 4
Recorded name: 4
Reward: 1
Tokens in / out: 3,041 / 605
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 5+
Task ID: 5
Recorded name: 5
Reward: 1
Tokens in / out: 2,974 / 1,036
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 6+
Task ID: 6
Recorded name: 6
Reward: 1
Tokens in / out: 16,275 / 2,886
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 8+
Task ID: 8
Recorded name: 8
Reward: 1
Tokens in / out: 2,638 / 535
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 10+
Task ID: 10
Recorded name: 10
Reward: 1
Tokens in / out: 5,213 / 1,115
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 11+
Task ID: 11
Recorded name: 11
Reward: 1
Tokens in / out: 8,466 / 1,302
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 12+
Task ID: 12
Recorded name: 12
Reward: 1
Tokens in / out: 8,312 / 6,149
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 13+
Task ID: 13
Recorded name: 13
Reward: 1
Tokens in / out: 2,826 / 977
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 14+
Task ID: 14
Recorded name: 14
Reward: 1
Tokens in / out: 7,836 / 1,502
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 15+
Task ID: 15
Recorded name: 15
Reward: 1
Tokens in / out: 5,393 / 1,368
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 16+
Task ID: 16
Recorded name: 16
Reward: 1
Tokens in / out: 2,916 / 790
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 18+
Task ID: 18
Recorded name: 18
Reward: 1
Tokens in / out: 7,490 / 1,330
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 19+
Task ID: 19
Recorded name: 19
Reward: 1
Tokens in / out: 2,722 / 526
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 20+
Task ID: 20
Recorded name: 20
Reward: 1
Tokens in / out: 3,456 / 1,602
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 21+
Task ID: 21
Recorded name: 21
Reward: 1
Tokens in / out: 4,278 / 771
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 22+
Task ID: 22
Recorded name: 22
Reward: 1
Tokens in / out: 21,464 / 5,358
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 23+
Task ID: 23
Recorded name: 23
Reward: 1
Tokens in / out: 60,357 / 8,645
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 26+
Task ID: 26
Recorded name: 26
Reward: 1
Tokens in / out: 2,740 / 642
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 27+
Task ID: 27
Recorded name: 27
Reward: 1
Tokens in / out: 4,004 / 1,792
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 28+
Task ID: 28
Recorded name: 28
Reward: 1
Tokens in / out: 4,829 / 2,010
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 31+
Task ID: 31
Recorded name: 31
Reward: 1
Tokens in / out: 7,295 / 1,432
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.