LocalsOnly · measured2026-09-17
SWE-bench Verified
swe-bench-verified · 100 tasks. Compare only matched task sets and protocols.
Qwen 3.8 Flash-Next · UD-IQ3_XXS · GB10 · 128GB · llama.cpp
● Tested by LocalsOnlyWeight pin not recorded on this receipt. No download URL.
Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.
Tokens per second · see measurement basis
As recorded on this receipt
Run configuration & provenance +
- Context
- 65,536
- Temperature
- Not recorded
- Wall time
- 3546.9 minutes
- Weight file
- Provider-managed / not reported
- Revision
- Not reported
- Reasoning
- Not reported
- Agent version
- Not reported
- Output token limit
- Not reported
- Dataset revision
- sha256:b934b0cc3dc800fe945eaf9f1623329db97ee3133c706d20644524c7759fb341
- Harness host
- Not reported
- Model host
- Asus gx10-e789 · :8081
- Input tokens
- 61,002,821
- Output tokens
- 3,177,305
- Cached input tokens
- 57,907,388
- Agent turn / step limit
- 50
- Concurrency
- 1
- Weight file size
- Not reported
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
Harbor terminus-2 on Kris Mac mini (docker, DOCKER_DEFAULT_PLATFORM=linux/amd64) -> Asus gx10-e789 llama.cpp OpenAI-compat [local endpoint] (qwen3.8-flash-next UD-IQ3_XXS, n_ctx 65536, thinking OFF, max_turns=50, k=1 n=1). Job swever-mac-asus-flashnext-n100-20260915a. RECEIPT — thin terminus-2 thinking-off for local headline parity; NOT Claude Code official-compare. Hardware evidence id spark-1x = Asus gx10-e789 (NOT dgx-spark / NOT branded Spark).
Run ID: measured-spark-1x-unsloth-ud-iq3_xxs-swe-bench-verified-n100-2026-09-17Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
All 100 recorded tasks, before filters or pagination. 25 of 100 matching tasks shown below. Recorded issues can also occur on scored tasks.
PassedAstropy astropy 8707+
Task ID: astropy__astropy-8707
Recorded name: astropy__astropy-8707
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedAstropy astropy 13398+
Task ID: astropy__astropy-13398
Recorded name: astropy__astropy-13398
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedAstropy astropy 13579+
Task ID: astropy__astropy-13579
Recorded name: astropy__astropy-13579
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedAstropy astropy 14096+
Task ID: astropy__astropy-14096
Recorded name: astropy__astropy-14096
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedAstropy astropy 14369+
Task ID: astropy__astropy-14369
Recorded name: astropy__astropy-14369
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedAstropy astropy 14995+
Task ID: astropy__astropy-14995
Recorded name: astropy__astropy-14995
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 7530+
Task ID: django__django-7530
Recorded name: django__django-7530
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 11099+
Task ID: django__django-11099
Recorded name: django__django-11099
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 11141+
Task ID: django__django-11141
Recorded name: django__django-11141
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 11179+
Task ID: django__django-11179
Recorded name: django__django-11179
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 11477+
Task ID: django__django-11477
Recorded name: django__django-11477
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 11490+
Task ID: django__django-11490
Recorded name: django__django-11490
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 11951+
Task ID: django__django-11951
Recorded name: django__django-11951
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 12262+
Task ID: django__django-12262
Recorded name: django__django-12262
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 12419+
Task ID: django__django-12419
Recorded name: django__django-12419
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13023+
Task ID: django__django-13023
Recorded name: django__django-13023
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13033+
Task ID: django__django-13033
Recorded name: django__django-13033
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13346+
Task ID: django__django-13346
Recorded name: django__django-13346
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13406+
Task ID: django__django-13406
Recorded name: django__django-13406
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13417+
Task ID: django__django-13417
Recorded name: django__django-13417
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13794+
Task ID: django__django-13794
Recorded name: django__django-13794
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 13933+
Task ID: django__django-13933
Recorded name: django__django-13933
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 14122+
Task ID: django__django-14122
Recorded name: django__django-14122
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 14140+
Task ID: django__django-14140
Recorded name: django__django-14140
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDjango django 14376+
Task ID: django__django-14376
Recorded name: django__django-14376
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.