LocalsOnlyevaluationsHow to read this
← Model evidence

LocalsOnly · measured2026-09-04

LiveCodeBench

Version 6.0 · 100 tasks. Compare only matched task sets and protocols.

Qwen 3.8 27B · UD-Q4_K_XL · GB10 · 128GB · llama.cpp

● Tested by LocalsOnly
WALL-CLOCK TIME8.7 h
INPUT TOKENS4,021,050

Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.

Reported score66.0%66 of 100 tasks passed
Throughput11.5 t/s

Tokens per second · see measurement basis

Concurrency1

As recorded on this receipt

17 infrastructure outcomes are recorded. Failure counts may overlap with task outcomes.

Reported category outcomes

Each category keeps its own recorded denominator. Some categories exclude unscored trials. Mean reward, when present, is partial credit.

atcoder abc
80.0%
32 / 4080.0% passed · mean reward 80.0%
atcoder arc
—
0 / 0No scored tasks
codeforces like
100.0%
1 / 1100.0% passed · mean reward 100.0%
leetcode or numeric
78.6%
33 / 4278.6% passed · mean reward 78.6%
Run configuration & provenance +
Context
32,768
Temperature
0
Wall time
522.7 minutes
Revision
4ca720788d1e01f1bff70c033e0d0028fd02e502
Reasoning
Not reported
Agent version
2.0.0
Output token limit
Not reported
Dataset revision
harbor-datasets@cfad8d97c75fb9e28c7b6b74b7fadb23dae57ab6 path datasets/livecodebench/release_v6
Harness host
Mac mini · 64GB
Model host
ASUS GX10 · 128GB
Input tokens
4,021,050
Output tokens
228,151
Cached input tokens
3,397,956
Agent turn / step limit
50
Concurrency
1
Weight file size
17.56 GB

Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.

terminus-2

Run ID: measured-spark-1x-unsloth-ud-q4_k_xl-livecodebench-6.0-2026-09-04
Tasks

Task explorer

Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.

100 task records
66 Passed17 Not passed17 Unscored · recorded issue

All 100 recorded tasks, before filters or pagination. 25 of 100 matching tasks shown below. Recorded issues can also occur on scored tasks.

Passed1873 d+

Task ID: 1873_d
Recorded name: 1873_d

Reward: 1

Tokens in / out: 110,417 / 3,839

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 2848+

Task ID: 2848
Recorded name: 2848

Reward: 1

Tokens in / out: 31,073 / 1,979

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 2857+

Task ID: 2857
Recorded name: 2857

Reward: 1

Tokens in / out: 47,959 / 2,771

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 2954+

Task ID: 2954
Recorded name: 2954

Reward: 1

Tokens in / out: 22,984 / 1,335

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 2955+

Task ID: 2955
Recorded name: 2955

Reward: 1

Tokens in / out: 7,620 / 1,373

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3034+

Task ID: 3034
Recorded name: 3034

Reward: 1

Tokens in / out: 17,480 / 660

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3163+

Task ID: 3163
Recorded name: 3163

Reward: 1

Tokens in / out: 28,393 / 1,644

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3193+

Task ID: 3193
Recorded name: 3193

Reward: 1

Tokens in / out: 28,696 / 1,457

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3194+

Task ID: 3194
Recorded name: 3194

Reward: 1

Tokens in / out: 30,983 / 831

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3195+

Task ID: 3195
Recorded name: 3195

Reward: 1

Tokens in / out: 63,129 / 3,420

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3199+

Task ID: 3199
Recorded name: 3199

Reward: 1

Tokens in / out: 29,027 / 1,757

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3206+

Task ID: 3206
Recorded name: 3206

Reward: 1

Tokens in / out: 37,967 / 1,249

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3265+

Task ID: 3265
Recorded name: 3265

Reward: 1

Tokens in / out: 45,300 / 2,510

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3308+

Task ID: 3308
Recorded name: 3308

Reward: 1

Tokens in / out: 77,639 / 2,821

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3320+

Task ID: 3320
Recorded name: 3320

Reward: 1

Tokens in / out: 42,709 / 1,681

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3353+

Task ID: 3353
Recorded name: 3353

Reward: 1

Tokens in / out: 13,548 / 1,835

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3387+

Task ID: 3387
Recorded name: 3387

Reward: 1

Tokens in / out: 41,235 / 3,443

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3450+

Task ID: 3450
Recorded name: 3450

Reward: 1

Tokens in / out: 37,082 / 1,479

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3468+

Task ID: 3468
Recorded name: 3468

Reward: 1

Tokens in / out: 22,517 / 950

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3508+

Task ID: 3508
Recorded name: 3508

Reward: 1

Tokens in / out: 45,579 / 1,933

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3518+

Task ID: 3518
Recorded name: 3518

Reward: 1

Tokens in / out: 31,528 / 1,693

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3535+

Task ID: 3535
Recorded name: 3535

Reward: 1

Tokens in / out: 103,929 / 3,319

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3553+

Task ID: 3553
Recorded name: 3553

Reward: 1

Tokens in / out: 28,741 / 1,152

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3653+

Task ID: 3653
Recorded name: 3653

Reward: 1

Tokens in / out: 56,461 / 1,995

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedTask ID 3656+

Task ID: 3656
Recorded name: 3656

Reward: 1

Tokens in / out: 52,903 / 2,202

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
Showing 25 of 100 tasks