Published reference2026-08-13
LiveCodeBench
Version 6.0 · sample size not reported. Compare only matched task sets and protocols.
Qwen 3.8 27B · BF16 reference · Qwen · Reported evaluation
↗ Published resultQwen
Protocol as described by the publisher
Qwen 3.8 27B official model card ↗Reported score90.3%
Throughput—
Tokens per second · see measurement basis
Concurrency—
As recorded on this receipt
Published reference. This is a source-reported result, not a test run by this lab. Publisher-reported result for the reference model. This is not a test of the local GGUF quantization.
Run configuration & provenance +
- Context
- Not recorded
- Temperature
- Not recorded
- Wall time
- Not recorded
- Weight file
- Provider-managed / not reported
- Revision
- Not reported
- Reasoning
- Not reported
- Agent version
- Not reported
- Output token limit
- Not reported
- Dataset revision
- Not reported
- Harness host
- Not reported
- Model host
- Published reference
- Input tokens
- Not reported
- Output tokens
- Not reported
- Cached input tokens
- Not reported
- Agent turn / step limit
- Not reported
- Concurrency
- Not reported
- Weight file size
- Not reported
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
Provider evaluation
Publisher-reported result for the reference model. This is not a test of the local GGUF quantization.
Run ID: research-qwen-3.8-27b-published-reference-livecodebench-6.0Tasks
Task explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
↗
No task records in this receipt.
The headline or summary is available above. Individual outcomes have not been provided.
Explore test coverage →