LocalsOnly · measured2026-09-15
Terminal-Bench 2.1
Version 2.1 · 89 tasks. Compare only matched task sets and protocols.
Qwen 3.8 Flash-Next · UD-IQ3_XXS · GB10 · 128GB · llama.cpp
● Tested by LocalsOnlyWeight pin not recorded on this receipt. No download URL.
Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.
Tokens per second · see measurement basis
As recorded on this receipt
Run configuration & provenance +
- Context
- Not recorded
- Temperature
- Not recorded
- Wall time
- 10455.8 minutes
- Weight file
- Provider-managed / not reported
- Revision
- Not reported
- Reasoning
- off
- Agent version
- 2.0.0
- Output token limit
- Not reported
- Dataset revision
- sha256:7d7bdc1cbedad549fc1140404bd4dc45e5fd0ea7c4186773687d177ad3a0699a
- Harness host
- Mac mini · 64GB
- Model host
- ASUS GX10 · 128GB
- Input tokens
- 56,008,494
- Output tokens
- 1,349,423
- Cached input tokens
- 22,004,494
- Agent turn / step limit
- 40
- Concurrency
- 1
- Weight file size
- Not reported
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
Harbor terminus-2 on Kris Mac mini (docker) -> Asus gx10-e789 llama.cpp OpenAI-compat [local endpoint] (qwen3.8-flash-next UD-IQ3_XXS, thinking OFF, max_turns=40, agent-timeout×4, timeout×2). Job tb21-mac-dgx-flash-measured-20260907. RECEIPT — thin parity with published Qwen 3.8 27B TB 2.1 terminus-2 path; NOT thinking-on official compare. Hardware evidence id spark-1x = Asus gx10-e789 (NOT dgx-spark / NOT branded Spark).
Run ID: measured-spark-1x-unsloth-ud-iq3_xxs-terminal-bench-2.1-2026-09-15Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
All 89 recorded tasks, before filters or pagination. 25 of 89 matching tasks shown below. Recorded issues can also occur on scored tasks.
PassedAdaptive rejection sampler+
Task ID: adaptive-rejection-sampler
Recorded name: adaptive-rejection-sampler
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedBn fit modify+
Task ID: bn-fit-modify
Recorded name: bn-fit-modify
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedBreak filter js from html+
Task ID: break-filter-js-from-html
Recorded name: break-filter-js-from-html
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedBuild pmars+
Task ID: build-pmars
Recorded name: build-pmars
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedBuild pov ray+
Task ID: build-pov-ray
Recorded name: build-pov-ray
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedCancel async tasks+
Task ID: cancel-async-tasks
Recorded name: cancel-async-tasks
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedChess best move+
Task ID: chess-best-move
Recorded name: chess-best-move
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedConfigure git webserver+
Task ID: configure-git-webserver
Recorded name: configure-git-webserver
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedConstraints scheduling+
Task ID: constraints-scheduling
Recorded name: constraints-scheduling
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedCount dataset tokens+
Task ID: count-dataset-tokens
Recorded name: count-dataset-tokens
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedCustom memory heap crash+
Task ID: custom-memory-heap-crash
Recorded name: custom-memory-heap-crash
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedDistribution search+
Task ID: distribution-search
Recorded name: distribution-search
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedExtract elf+
Task ID: extract-elf
Recorded name: extract-elf
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFinancial document processor+
Task ID: financial-document-processor
Recorded name: financial-document-processor
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFix code vulnerability+
Task ID: fix-code-vulnerability
Recorded name: fix-code-vulnerability
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFix git+
Task ID: fix-git
Recorded name: fix-git
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFix ocaml gc+
Task ID: fix-ocaml-gc
Recorded name: fix-ocaml-gc
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedGit leak recovery+
Task ID: git-leak-recovery
Recorded name: git-leak-recovery
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedHeadless terminal+
Task ID: headless-terminal
Recorded name: headless-terminal
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedHf model inference+
Task ID: hf-model-inference
Recorded name: hf-model-inference
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedKv store grpc+
Task ID: kv-store-grpc
Recorded name: kv-store-grpc
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedLlm inference batching scheduler+
Task ID: llm-inference-batching-scheduler
Recorded name: llm-inference-batching-scheduler
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedLog summary date ranges+
Task ID: log-summary-date-ranges
Recorded name: log-summary-date-ranges
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedMailman+
Task ID: mailman
Recorded name: mailman
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedMerge diff arc agi task+
Task ID: merge-diff-arc-agi-task
Recorded name: merge-diff-arc-agi-task
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.