Alibaba · Proprietary · tested 9 Oct 2026

Qwen3.8 Max Max effort

Overall rank#21 of 25

Safety refusals affected this result

Alibaba's cyber safeguards stopped attempts in 97 of 100 labs. Stopped attempts score zero.

Its cost, tokens and time don't cover the full benchmark, so they're left out of comparisons. How refusals are scored

How this model behaved

Tested through Alibaba's hosted API, which every provider of Qwen3.8 Max passes requests to. Alibaba's input filter stopped attempts partway through the task in 97 of 100 labs; the model itself almost never declined. The open-weights release (Qwen3.8-2.4T-A95B) is a separate build and wasn't tested.

Solves7/1003 first attempt · +4 retry

Rungs proven30/40012 first attempt · +18 retry

Cost to runn/aNot comparable: safety refusals

Tokens usedn/aNot comparable: safety refusals

Time per labn/aNot comparable: safety refusals

Where it places

Each line is one metric across all 25 configurations. Right is always better; this model is the large dot.

Solveslabs solved, of 100

worsebetter

7#21 of 25

Rungs provenrungs proven, of 400

worsebetter

30#22 of 25

First-attempt solvessolved on the first attempt

worsebetter

3#21 of 25

Cost per solveUSD per solved lab

worsebetter

n/anot ranked

By vulnerability class

How Qwen3.8 Max (Max) did on each type of vulnerability. Shown as counts, because some classes have only a few labs.

Authentication / authorisation bypassSafety refusals in 27 of 28 labs5 of 28 solved20 of 112 rungs
Information disclosureSafety refusals in 11 of 12 labs1 of 12 solved4 of 48 rungs
IDORSafety refusals in 11 of 11 labs0 of 11 solved0 of 44 rungs
SSRFSafety refusals in 10 of 10 labs0 of 10 solved0 of 40 rungs
Business logicSafety refusals in 10 of 10 labs0 of 10 solved0 of 40 rungs
Key or secret exposureSafety refusals in 8 of 8 labs0 of 8 solved0 of 32 rungs
XSSSafety refusals in 6 of 6 labs0 of 6 solved0 of 24 rungs
Token theftSafety refusals in 5 of 5 labs0 of 5 solved0 of 20 rungs

Fewer than 5 labs each: one lab changes these a lot, so read them with care.

Supply chainSafety refusals in 4 of 4 labs0 of 4 solved2 of 16 rungs
Remote code executionSafety refusals in 3 of 3 labs0 of 3 solved0 of 12 rungs
SQL injectionSafety refusals in 1 of 2 labs1 of 2 solved4 of 8 rungs
File inclusionSafety refusals in 1 of 1 lab0 of 1 solved0 of 4 rungs

Provider performance

Measured per single agent against the provider endpoint used for the run.

Response time: 9.47 s median · 27.50 s p95
Output speed: 34.9 tok/s
API success rate: 88.53%
Input context: 4.8K median · 19.2K p95

About this result

Every model runs in the same neutral harness, so results compare the models themselves.

Harness: BB Arena neutral harness
Safety refusals: 97 of 100 labs

See Qwen3.8 Max (Max) highlighted on every chart →