LocalsOnly · measured2026-09-15
GPQA Diamond
Diamond · version 1.0 · 198 tasks. Compare only matched task sets and protocols.
DeepSeek V4 Flash 0731 · UD-IQ3_XXS · DGX Spark · 128GB · llama.cpp
● Tested by LocalsOnlyWeight pin not recorded on this receipt. No download URL.
Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.
Tokens per second · see measurement basis
As recorded on this receipt
Reported category outcomes
Each category keeps its own recorded denominator. Some categories exclude unscored trials. Mean reward, when present, is partial credit.
Run configuration & provenance +
- Context
- Not recorded
- Temperature
- Not recorded
- Wall time
- 4097.9 minutes
- Weight file
- Provider-managed / not reported
- Revision
- Not reported
- Reasoning
- Not reported
- Agent version
- Not reported
- Output token limit
- Not reported
- Dataset revision
- harbor gpqa-diamond@1.0 (198 tasks) · harbor-datasets 1983ac5c4d43f43cb7a9af9f89c54d09025589ec
- Harness host
- Mac mini · Harbor docker
- Model host
- DGX Spark spark-5c2f · :8888
- Input tokens
- 881,387
- Output tokens
- 1,140,339
- Cached input tokens
- 0
- Agent turn / step limit
- 50
- Concurrency
- 1
- Weight file size
- Not reported
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
Harbor terminus-2 on Kris Mac mini (docker) -> DGX Spark spark-5c2f llama.cpp OpenAI-compat [local endpoint] (deepseek-v4-flash UD-IQ3_XXS, thinking on, max_turns=50). Job gpqa-mac-dgx-dsv4flash-20260912a. Dataset gpqa-diamond@1.0. NOT Asus gx10-e789.
Run ID: measured-dgx-spark-unsloth-ud-iq3_xxs-gpqa-diamond-1.0-2026-09-15Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
All 198 recorded tasks, before filters or pagination. 25 of 198 matching tasks shown below. Recorded issues can also occur on scored tasks.
PassedTask ID 0+
Task ID: 0
Recorded name: 0
Reward: 1
Tokens in / out: 3,663 / 1,873
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 1+
Task ID: 1
Recorded name: 1
Reward: 1
Tokens in / out: 3,753 / 7,042
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 2+
Task ID: 2
Recorded name: 2
Reward: 1
Tokens in / out: 2,329 / 1,075
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 3+
Task ID: 3
Recorded name: 3
Reward: 1
Tokens in / out: 2,384 / 1,808
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 4+
Task ID: 4
Recorded name: 4
Reward: 1
Tokens in / out: 2,817 / 3,146
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 5+
Task ID: 5
Recorded name: 5
Reward: 1
Tokens in / out: 2,462 / 1,544
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 6+
Task ID: 6
Recorded name: 6
Reward: 1
Tokens in / out: 2,394 / 3,415
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 9+
Task ID: 9
Recorded name: 9
Reward: 1
Tokens in / out: 2,394 / 1,045
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 10+
Task ID: 10
Recorded name: 10
Reward: 1
Tokens in / out: 4,482 / 15,018
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 11+
Task ID: 11
Recorded name: 11
Reward: 1
Tokens in / out: 4,107 / 893
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 13+
Task ID: 13
Recorded name: 13
Reward: 1
Tokens in / out: 3,788 / 7,802
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 14+
Task ID: 14
Recorded name: 14
Reward: 1
Tokens in / out: 4,518 / 8,762
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 16+
Task ID: 16
Recorded name: 16
Reward: 1
Tokens in / out: 2,293 / 1,108
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 19+
Task ID: 19
Recorded name: 19
Reward: 1
Tokens in / out: 2,395 / 771
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 20+
Task ID: 20
Recorded name: 20
Reward: 1
Tokens in / out: 2,579 / 6,785
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 21+
Task ID: 21
Recorded name: 21
Reward: 1
Tokens in / out: 2,338 / 2,232
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 23+
Task ID: 23
Recorded name: 23
Reward: 1
Tokens in / out: 2,547 / 5,774
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 24+
Task ID: 24
Recorded name: 24
Reward: 1
Tokens in / out: 2,777 / 7,015
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 26+
Task ID: 26
Recorded name: 26
Reward: 1
Tokens in / out: 3,786 / 2,152
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 27+
Task ID: 27
Recorded name: 27
Reward: 1
Tokens in / out: 6,142 / 23,657
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 28+
Task ID: 28
Recorded name: 28
Reward: 1
Tokens in / out: 6,986 / 9,559
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 29+
Task ID: 29
Recorded name: 29
Reward: 1
Tokens in / out: 3,765 / 14,625
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 31+
Task ID: 31
Recorded name: 31
Reward: 1
Tokens in / out: 7,368 / 9,911
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 34+
Task ID: 34
Recorded name: 34
Reward: 1
Tokens in / out: 2,748 / 10,557
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedTask ID 35+
Task ID: 35
Recorded name: 35
Reward: 1
Tokens in / out: 4,332 / 3,081
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.