Published reference2026-08-26
AutomationBench*
Published public evaluation · 600-task set. Task sets and protocols differ. A local sample is not established as a subset of the published public set; scores remain separate.
GLM-5.3-Flash · Published reference · Z.ai · Reported evaluation
↗ Published resultAutomationBench v1.0.6
GLM-5.3-Flash: Frontier Intelligence, Flash Cost ↗Tokens per second · see measurement basis
As recorded on this receipt
Run configuration & provenance +
- Context
- Not recorded
- Temperature
- Not recorded
- Wall time
- Not recorded
- Weight file
- Provider-managed / not reported
- Revision
- Not reported
- Reasoning
- Not reported
- Agent version
- Not reported
- Output token limit
- Not reported
- Dataset revision
- Not reported
- Harness host
- Not reported
- Model host
- Published reference
- Input tokens
- Not reported
- Output tokens
- Not reported
- Cached input tokens
- Not reported
- Agent turn / step limit
- Not reported
- Concurrency
- Not reported
- Weight file size
- Not reported
Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.
Provider evaluation
Z.ai launch post: AutomationBench v1.0.6 48.8, including the null-type PR #13 fix. Filed on the public published column, not LocalsOnly’s local-300 office automationbench sample.
Run ID: research-glm-5.3-flash-published-reference-automationbench-publicTask explorer
Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.
No task records in this receipt.
The headline or summary is available above. Individual outcomes have not been provided.
Explore test coverage →