LocalsOnlyevaluationsHow to read this
← Model evidence

LocalsOnly · measured2026-09-14

SWE-bench Pro

Pro evaluation · 50 tasks. Compare only matched task sets and protocols.

Qwen 3.8 Flash-Next · UD-IQ3_XXS · GB10 · 128GB · llama.cpp

● Tested by LocalsOnly
WALL-CLOCK TIME45.4 h
INPUT TOKENS56,039,606

Recorded effort for this run. Wall time and token counts are not a dollar cost; hardware power and utilization also matter.

Reported score92.0%46 of 50 tasks passed
Throughput23.0 t/s

Tokens per second · see measurement basis

Concurrency1

As recorded on this receipt

27 infrastructure outcomes are recorded. Failure counts may overlap with task outcomes.
Run configuration & provenance +
Context
65,536
Temperature
Not recorded
Wall time
2723.8 minutes
Weight file
Provider-managed / not reported
Revision
Not reported
Reasoning
Not reported
Agent version
Not reported
Output token limit
Not reported
Dataset revision
sha256:88411d32ff27e53a4c1a7e29f0c2aeba180c8e5d60f221cab5ed56325f33549d
Harness host
Not reported
Model host
Asus gx10-e789 · :8081
Input tokens
56,039,606
Output tokens
1,752,262
Cached input tokens
53,957,766
Agent turn / step limit
50
Concurrency
1
Weight file size
Not reported

Throughput measurement: Measurement method not separately reported. This should not be treated as standardized decode-only speed.

terminus-2

Run ID: measured-spark-1x-unsloth-ud-iq3_xxs-swe-bench-pro-n50-2026-09-14
Tasks

Task explorer

Passed tasks first, then other outcomes grouped by recorded issue. Use the filters to inspect a particular outcome.

50 task records
46 Passed4 Not passed

All 50 recorded tasks, before filters or pagination. 25 of 50 matching tasks shown below. Recorded issues can also occur on scored tasks.

PassedScale ai/instance ansible ansible 4c5ce5a1a9e79a845aff4978cfeb72a0d4ecf7d6 v1055803c3a812189a1133297f7f5468579283f86+

Task ID: scale-ai/instance_ansible__ansible-4c5ce5a1a9e79a845aff4978cfeb72a0d4ecf7d6-v1055803c3a812189a1133297f7f5468579283f86
Recorded name: scale-ai/instance_ansible__ansible-4c5ce5a1a9e79a845aff4978cfeb72a0d4ecf7d6-v1055803c3a812189a1133297f7f5468579283f86

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance ansible ansible 3889ddeb4b780ab4bac9ca2e75f8c1991bcabe83 v0f01c69f1e2528b935359cfe578530722bca2c59+

Task ID: scale-ai/instance_ansible__ansible-3889ddeb4b780ab4bac9ca2e75f8c1991bcabe83-v0f01c69f1e2528b935359cfe578530722bca2c59
Recorded name: scale-ai/instance_ansible__ansible-3889ddeb4b780ab4bac9ca2e75f8c1991bcabe83-v0f01c69f1e2528b935359cfe578530722bca2c59

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance ansible ansible a7d2a4e03209cff1e97e59fd54bb2b05fdbdbec6 v0f01c69f1e2528b935359cfe578530722bca2c59+

Task ID: scale-ai/instance_ansible__ansible-a7d2a4e03209cff1e97e59fd54bb2b05fdbdbec6-v0f01c69f1e2528b935359cfe578530722bca2c59
Recorded name: scale-ai/instance_ansible__ansible-a7d2a4e03209cff1e97e59fd54bb2b05fdbdbec6-v0f01c69f1e2528b935359cfe578530722bca2c59

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance ansible ansible d6d2251929c84c3aa883bad7db0f19cc9ff0339e v30a923fb5c164d6cd18280c02422f75e611e8fb2+

Task ID: scale-ai/instance_ansible__ansible-d6d2251929c84c3aa883bad7db0f19cc9ff0339e-v30a923fb5c164d6cd18280c02422f75e611e8fb2
Recorded name: scale-ai/instance_ansible__ansible-d6d2251929c84c3aa883bad7db0f19cc9ff0339e-v30a923fb5c164d6cd18280c02422f75e611e8fb2

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt 5aef5a14890aa145c22d864a834694bae3a6f112+

Task ID: scale-ai/instance_flipt-io__flipt-5aef5a14890aa145c22d864a834694bae3a6f112
Recorded name: scale-ai/instance_flipt-io__flipt-5aef5a14890aa145c22d864a834694bae3a6f112

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt 9f8127f225a86245fa35dca4885c2daef824ee55+

Task ID: scale-ai/instance_flipt-io__flipt-9f8127f225a86245fa35dca4885c2daef824ee55
Recorded name: scale-ai/instance_flipt-io__flipt-9f8127f225a86245fa35dca4885c2daef824ee55

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt 518ec324b66a07fdd95464a5e9ca5fe7681ad8f9+

Task ID: scale-ai/instance_flipt-io__flipt-518ec324b66a07fdd95464a5e9ca5fe7681ad8f9
Recorded name: scale-ai/instance_flipt-io__flipt-518ec324b66a07fdd95464a5e9ca5fe7681ad8f9

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt b4bb5e13006a729bc0eed8fe6ea18cff54acdacb+

Task ID: scale-ai/instance_flipt-io__flipt-b4bb5e13006a729bc0eed8fe6ea18cff54acdacb
Recorded name: scale-ai/instance_flipt-io__flipt-b4bb5e13006a729bc0eed8fe6ea18cff54acdacb

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt b433bd05ce405837804693bebd5f4b88d87133c8+

Task ID: scale-ai/instance_flipt-io__flipt-b433bd05ce405837804693bebd5f4b88d87133c8
Recorded name: scale-ai/instance_flipt-io__flipt-b433bd05ce405837804693bebd5f4b88d87133c8

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt dae029cba7cdb98dfb1a6b416c00d324241e6063+

Task ID: scale-ai/instance_flipt-io__flipt-dae029cba7cdb98dfb1a6b416c00d324241e6063
Recorded name: scale-ai/instance_flipt-io__flipt-dae029cba7cdb98dfb1a6b416c00d324241e6063

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance flipt io flipt e2bd19dafa7166c96b082fb2a59eb54b4be0d778+

Task ID: scale-ai/instance_flipt-io__flipt-e2bd19dafa7166c96b082fb2a59eb54b4be0d778
Recorded name: scale-ai/instance_flipt-io__flipt-e2bd19dafa7166c96b082fb2a59eb54b4be0d778

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance future architect vuls 030b2e03525d68d74cb749959aac2d7f3fc0effa+

Task ID: scale-ai/instance_future-architect__vuls-030b2e03525d68d74cb749959aac2d7f3fc0effa
Recorded name: scale-ai/instance_future-architect__vuls-030b2e03525d68d74cb749959aac2d7f3fc0effa

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance future architect vuls 1832b4ee3a20177ad313d806983127cb6e53f5cf+

Task ID: scale-ai/instance_future-architect__vuls-1832b4ee3a20177ad313d806983127cb6e53f5cf
Recorded name: scale-ai/instance_future-architect__vuls-1832b4ee3a20177ad313d806983127cb6e53f5cf

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance future architect vuls ef2be3d6ea4c0a13674aaab08b182eca4e2b9a17 v264a82e2f4818e30f5a25e4da53b27ba119f62b5+

Task ID: scale-ai/instance_future-architect__vuls-ef2be3d6ea4c0a13674aaab08b182eca4e2b9a17-v264a82e2f4818e30f5a25e4da53b27ba119f62b5
Recorded name: scale-ai/instance_future-architect__vuls-ef2be3d6ea4c0a13674aaab08b182eca4e2b9a17-v264a82e2f4818e30f5a25e4da53b27ba119f62b5

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance internetarchive openlibrary 3f7db6bbbcc7c418b3db72d157c6aed1d45b2ccf v430f20c722405e462d9ef44dee7d34c41e76fe7a+

Task ID: scale-ai/instance_internetarchive__openlibrary-3f7db6bbbcc7c418b3db72d157c6aed1d45b2ccf-v430f20c722405e462d9ef44dee7d34c41e76fe7a
Recorded name: scale-ai/instance_internetarchive__openlibrary-3f7db6bbbcc7c418b3db72d157c6aed1d45b2ccf-v430f20c722405e462d9ef44dee7d34c41e76fe7a

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance internetarchive openlibrary 3f580a5f244c299d936d73d9e327ba873b6401d9 v0f5aece3601a5b4419f7ccec1dbda2071be28ee4+

Task ID: scale-ai/instance_internetarchive__openlibrary-3f580a5f244c299d936d73d9e327ba873b6401d9-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4
Recorded name: scale-ai/instance_internetarchive__openlibrary-3f580a5f244c299d936d73d9e327ba873b6401d9-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance internetarchive openlibrary 7f6b722a10f822171501d027cad60afe53337732 ve8c8d62a2b60610a3c4631f5f23ed866bada9818+

Task ID: scale-ai/instance_internetarchive__openlibrary-7f6b722a10f822171501d027cad60afe53337732-ve8c8d62a2b60610a3c4631f5f23ed866bada9818
Recorded name: scale-ai/instance_internetarchive__openlibrary-7f6b722a10f822171501d027cad60afe53337732-ve8c8d62a2b60610a3c4631f5f23ed866bada9818

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance internetarchive openlibrary 910b08570210509f3bcfebf35c093a48243fe754 v0f5aece3601a5b4419f7ccec1dbda2071be28ee4+

Task ID: scale-ai/instance_internetarchive__openlibrary-910b08570210509f3bcfebf35c093a48243fe754-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4
Recorded name: scale-ai/instance_internetarchive__openlibrary-910b08570210509f3bcfebf35c093a48243fe754-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance internetarchive openlibrary 25858f9f0c165df25742acf8309ce909773f0cdd v13642507b4fc1f8d234172bf8129942da2c2ca26+

Task ID: scale-ai/instance_internetarchive__openlibrary-25858f9f0c165df25742acf8309ce909773f0cdd-v13642507b4fc1f8d234172bf8129942da2c2ca26
Recorded name: scale-ai/instance_internetarchive__openlibrary-25858f9f0c165df25742acf8309ce909773f0cdd-v13642507b4fc1f8d234172bf8129942da2c2ca26

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance navidrome navidrome 3f2d24695e9382125dfe5e6d6c8bbeb4a313a4f9+

Task ID: scale-ai/instance_navidrome__navidrome-3f2d24695e9382125dfe5e6d6c8bbeb4a313a4f9
Recorded name: scale-ai/instance_navidrome__navidrome-3f2d24695e9382125dfe5e6d6c8bbeb4a313a4f9

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance navidrome navidrome 812dc2090f20ac4f8ac271b6ed95be5889d1a3ca+

Task ID: scale-ai/instance_navidrome__navidrome-812dc2090f20ac4f8ac271b6ed95be5889d1a3ca
Recorded name: scale-ai/instance_navidrome__navidrome-812dc2090f20ac4f8ac271b6ed95be5889d1a3ca

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance navidrome navidrome 7073d18b54da7e53274d11c9e2baef1242e8769e+

Task ID: scale-ai/instance_navidrome__navidrome-7073d18b54da7e53274d11c9e2baef1242e8769e
Recorded name: scale-ai/instance_navidrome__navidrome-7073d18b54da7e53274d11c9e2baef1242e8769e

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance navidrome navidrome 3972616585e82305eaf26aa25697b3f5f3082288+

Task ID: scale-ai/instance_navidrome__navidrome-3972616585e82305eaf26aa25697b3f5f3082288
Recorded name: scale-ai/instance_navidrome__navidrome-3972616585e82305eaf26aa25697b3f5f3082288

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance navidrome navidrome fa85e2a7816a6fe3829a4c0d8e893e982b0985da+

Task ID: scale-ai/instance_navidrome__navidrome-fa85e2a7816a6fe3829a4c0d8e893e982b0985da
Recorded name: scale-ai/instance_navidrome__navidrome-fa85e2a7816a6fe3829a4c0d8e893e982b0985da

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
PassedScale ai/instance nodebb nodebb 70b4a0e2aebebe8f2f559de6680093d96a697b2f vnan+

Task ID: scale-ai/instance_nodebb__nodebb-70b4a0e2aebebe8f2f559de6680093d96a697b2f-vnan
Recorded name: scale-ai/instance_nodebb__nodebb-70b4a0e2aebebe8f2f559de6680093d96a697b2f-vnan

Reward: 1

Recorded issue: No failure explanation in this task record.

The receipt contains outcome metadata. Full prompts and execution transcripts are not included in this view.
Showing 25 of 50 tasks