Passedsales
Negative selection · sales
Completed the recorded checks.
Exact task metadata
sales.negative_selection · Task ID 2
stop
Reward1
Assertions7 / 7
Steps14
Tool calls29
Model calls14
Tokens in / out339,846 / 5,917
Office & CRMOffice automation
AutomationBench · local 300*
* Local evaluation · 300 tasks. Task sets and protocols differ. A local sample is not established as a subset of the published public set; scores remain separate.
Can it actually finish the office workflow?
40.3%Fully completed · 121 / 300 tasks
GLM-5.3-Flash · NVFP4 (LibertAIDAI) · 2× GB10 (DGX Spark head + ASUS GX10 worker) · 256GB total
Inspect the measured run ↗How scoring works ↓THE QUESTION IT ANSWERS
Can it actually finish the office workflow?
Tests sales, marketing, operations, support, finance, and HR workflows. Completion requires every assertion to pass.
- 01Business workflow→
- 02Operate connected tools→
- 03Final-state assertions
Interpret the score Task sets and protocols differ. A local sample is not established as a subset of the published public set; scores remain separate.
BEYOND THE HEADLINE
What happened across 300 tasks?
Each block represents one recorded task, in receipt order from left to right, then top to bottom. Fill shows the outcome; work-category colors are not used here.
Fully passed121 40.3%
Partial progress160 53.3%
No credit19 6.3%
Tested by LocalsOnly · NVFP4 (LibertAIDAI) · 2× GB10 (DGX Spark head + ASUS GX10 worker) · 256GB total. Partial progress still requires further work before a task is complete.
Inspect individual task outcomes →What this test is
What this benchmark measures
Sales, marketing, operations, support, finance and HR workflows.
How it grades
How a task earns its score
Fully completed is nPass / nTasks. Mean reward is partial credit and stays a separate labeled note.
Some local tasks also record a setup issue (for example Runaway generation stopped on length; the rollout was cut off mid-work, not re-run, and scored as exported.).
SuiteAutomationBench · local 300
Tasks300 on the measured receipt
Fully completednPass / nTasks on the receipt
Mean rewardPartial credit; labeled separately
Setup issueRunaway generation stopped on length; the rollout was cut off mid-work, not re-run, and scored as exported.
Follow one task · this measured recipe
A passed task and a failed one
Same LocalsOnly receipt on 2× GB10 (DGX Spark head + ASUS GX10 worker) · 256GB total. GLM-5.3-Flash · NVFP4 (LibertAIDAI) · 2026-10-18. Both from sales. Assertions, steps, and tool calls are on the task record. There is no agent transcript on this page.
passed in 14 steps / 29 tools vs Runaway generation stopped on length; the rollout was cut off mid-work, not re-run, and scored as exported.
Abortedsales
Email zoom fuzzy · sales
The attempt stopped before completion. The record does not establish why.
Exact task metadata
sales.email_zoom_fuzzy · Task ID 16
length · Runaway generation stopped on length; the rollout was cut off mid-work, not re-run, and scored as exported.
Reward0
Assertions0 / 5
Steps4
Tool calls6
Model calls4
Tokens in / out15,950 / 94,119
Runaway generation stopped on length; the rollout was cut off mid-work, not re-run, and scored as exported.
Subject & category breakdown · this recipe
Results by subject or work category
Ranked by this file’s recorded fully completed rate. A blank rate is not a zero. Names come from the receipt.
- operations52.0%26/50 completed · reward 79.8%
- marketing48.0%24/50 completed · reward 86.1%
- finance40.0%20/50 completed · reward 75.0%
- hr36.0%18/50 completed · reward 71.8%
- sales34.0%17/50 completed · reward 62.4%
- support32.0%16/50 completed · reward 82.6%
Ranking
Results & published references
Place is assigned only among rows that share a comparable score on this board. Evaluation settings can differ across sources.
Tested by LocalsOnly
Results from the exact local setup shown below.
| # | Model / recipe | Fully completed ↓ | Runs on | Evidence | |
|---|---|---|---|---|---|
| 01 | ◎GLM-5.3-Flash · TensorFoldEXL3 TR3 4bpw · TensorFold | 48.7% | 2× GB10 (DGX Spark head + ASUS GX10 worker) · 256GB total | ● Tested by LocalsOnlyLocalsOnly | ↗ |
| 02 | ◎GLM-5.3-Flash · vLLMEXL3 TR3 4bpw · vLLM | 46.3% | 2× GB10 (DGX Spark head + ASUS GX10 worker) · 256GB total | ● Tested by LocalsOnlyLocalsOnly | ↗ |
| 03 | ✳Qwen 3.8 Flash-Next · llama.cppUD-IQ3_XXS · llama.cpp | 41.7% | GB10 · 128GB | ● Tested by LocalsOnlyLocalsOnly | ↗ |
| 04 | ◎GLM-5.3-Flash · SGLangNVFP4 (LibertAIDAI) · SGLang | 40.3% | 2× GB10 (DGX Spark head + ASUS GX10 worker) · 256GB total | ● Tested by LocalsOnlyLocalsOnly | ↗ |
| 05 | ◎DeepSeek V4 Flash · llama.cppUD-IQ3_XXS · llama.cpp | 19.3% | GB10 · 128GB | ● Tested by LocalsOnlyLocalsOnly | ↗ |
| 06 | ✳Qwen 3.8 27B · llama.cppUD-Q4_K_XL · llama.cpp | 18.3% | GB10 · 128GB | ● Tested by LocalsOnlyLocalsOnly | ↗ |