LocalsOnly · measured2026-09-18
SWE-bench Verified
swe-bench-verified · 100 tasks. Compare only matched task sets and protocols.
DeepSeek V4 Flash · UD-IQ3_XXS · GB10 · 128GB · llama.cpp
● Tested by LocalsOnlyWeight pin not recorded on this receipt. No download URL.
Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.
Tokens per second · see measurement basis
As recorded on this receipt
Run configuration & provenance +
- Context
- 32,768
- Temperature
- Not recorded
- Wall time
- 3877.7 minutes
- Weight file
- Provider-managed / not reported
- Revision
- Not reported
- Reasoning
- Not reported
- Agent version
- Not reported
- Output token limit
- Not reported
- Dataset revision
- sha256:b934b0cc3dc800fe945eaf9f1623329db97ee3133c706d20644524c7759fb341
- Harness host
- Not reported
- Model host
- DGX Spark · 128GB
- Input tokens
- Not reported
- Output tokens
- Not reported
- Cached input tokens
- Not reported
- Agent turn / step limit
- 50
- Concurrency
- 1
- Weight file size
- Not reported
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
Harbor terminus-2 on Kris Mac mini (docker, DOCKER_DEFAULT_PLATFORM=linux/amd64) -> DGX Spark spark-5c2f llama.cpp OpenAI-compat [local endpoint] (deepseek-v4-flash UD-IQ3_XXS, n_ctx 32768, thinking OFF, max_turns=50, k=1 n=1). Job swever-mac-dgx-dsv4flash-n100-20260915a. RECEIPT — thin terminus-2 thinking-off for local headline parity with Flash-Next Verified RECEIPT; NOT Claude Code official-compare. Hardware evidence id dgx-spark = DGX Spark spark-5c2f :8888 (NOT Asus gx10-e789 / NOT spark-1x).
Run ID: measured-dgx-spark-unsloth-ud-iq3_xxs-swe-bench-verified-n100-2026-09-18Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
All 100 recorded tasks, before filters or pagination. 25 of 100 matching tasks shown below. Recorded issues can also occur on scored tasks.
PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedUnnamed task+
Task ID:
Recorded name:
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.