LocalsOnly · measured2026-09-02
Terminal-Bench
Version 2.1 · 89 tasks. Compare only matched task sets and protocols.
Qwen 3.8 27B · UD-Q4_K_XL · GB10 · 128GB · llama.cpp
● Tested by LocalsOnlyRecorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.
Tokens per second · see measurement basis
As recorded on this receipt
Run configuration & provenance +
- Context
- 32,768
- Temperature
- 0
- Wall time
- 1537.9 minutes
- Weight file
- Qwen3.8-27B-UD-Q4_K_XL.gguf ↗
- Revision
- 4ca720788d1e01f1bff70c033e0d0028fd02e502
- Reasoning
- off
- Agent version
- 2.0.0
- Output token limit
- 4,096
- Dataset revision
- Not reported
- Harness host
- Mac mini · 64GB
- Model host
- ASUS GX10 · 128GB
- Input tokens
- 16,026,434
- Output tokens
- 627,836
- Cached input tokens
- 14,566,185
- Agent turn / step limit
- 30
- Concurrency
- 1
- Weight file size
- 17.56 GB
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
terminus-2
Run ID: measured-spark-1x-unsloth-ud-q4_k_xl-terminal-bench-2.1-2026-09-02Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
All 89 recorded tasks, before filters or pagination. 25 of 89 matching tasks shown below. Recorded issues can also occur on scored tasks.
PassedBuild pmars+
Task ID: build-pmars
Recorded name: build-pmars
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedConstraints scheduling+
Task ID: constraints-scheduling
Recorded name: constraints-scheduling
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedCount dataset tokens+
Task ID: count-dataset-tokens
Recorded name: count-dataset-tokens
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFilter js from html+
Task ID: filter-js-from-html
Recorded name: filter-js-from-html
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFinancial document processor+
Task ID: financial-document-processor
Recorded name: financial-document-processor
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFix code vulnerability+
Task ID: fix-code-vulnerability
Recorded name: fix-code-vulnerability
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedFix git+
Task ID: fix-git
Recorded name: fix-git
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedGit leak recovery+
Task ID: git-leak-recovery
Recorded name: git-leak-recovery
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedHeadless terminal+
Task ID: headless-terminal
Recorded name: headless-terminal
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedHf model inference+
Task ID: hf-model-inference
Recorded name: hf-model-inference
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedKv store grpc+
Task ID: kv-store-grpc
Recorded name: kv-store-grpc
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedLog summary date ranges+
Task ID: log-summary-date-ranges
Recorded name: log-summary-date-ranges
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedModernize scientific stack+
Task ID: modernize-scientific-stack
Recorded name: modernize-scientific-stack
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedMulti source data merger+
Task ID: multi-source-data-merger
Recorded name: multi-source-data-merger
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedNginx request logging+
Task ID: nginx-request-logging
Recorded name: nginx-request-logging
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedOpenssl selfsigned cert+
Task ID: openssl-selfsigned-cert
Recorded name: openssl-selfsigned-cert
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedPortfolio optimization+
Task ID: portfolio-optimization
Recorded name: portfolio-optimization
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedProve plus comm+
Task ID: prove-plus-comm
Recorded name: prove-plus-comm
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedPypi server+
Task ID: pypi-server
Recorded name: pypi-server
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedPytorch model cli+
Task ID: pytorch-model-cli
Recorded name: pytorch-model-cli
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedPytorch model recovery+
Task ID: pytorch-model-recovery
Recorded name: pytorch-model-recovery
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedReshard c4 data+
Task ID: reshard-c4-data
Recorded name: reshard-c4-data
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedSparql university+
Task ID: sparql-university
Recorded name: sparql-university
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedSqlite with gcov+
Task ID: sqlite-with-gcov
Recorded name: sqlite-with-gcov
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.PassedVulnerable secret+
Task ID: vulnerable-secret
Recorded name: vulnerable-secret
Reward: 1
Recorded issue: No failure explanation in this task record.
The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.