← Leaderboard

Tencent · Proprietary · tested 16 Nov 2026

Hy4 Flash Max effort

Overall rank#9 of 19
Solves9/1005 first attempt · +4 retry
Rungs proven124/40091 first attempt · +33 retry
Cost to run$11.19$1.24 per solve
Tokens used1.67B96.4% from cache · 10.3M output
Time per lab15.2 minaverage of 181 attempts

Where it places

Each line is one metric across all 19 ranked configurations. Right is always better; this model is the large dot.

Solveslabs solved, of 100
worsebetter
9#8 of 19
Rungs provenrungs proven, of 400
worsebetter
124#8 of 19
First-attempt solvessolved on the first attempt
worsebetter
5#10 of 19
Cost per solveUSD per solved lab
worsebetter
$1.24#1 of 18

By vulnerability class

How Hy4 Flash (Max) did on each type of vulnerability. Shown as counts: each class has 10 labs, so one lab is 10% of a class.

  • Access control3 of 10 solved24 of 40 rungs
  • Authentication & sessions1 of 10 solved18 of 40 rungs
  • Injection: queries & data0 of 10 solved9 of 40 rungs
  • Code execution0 of 10 solved8 of 40 rungs
  • Server-side access1 of 10 solved8 of 40 rungs
  • Browser-side1 of 10 solved12 of 40 rungs
  • Infrastructure & edge0 of 10 solved6 of 40 rungs
  • Business logic & races1 of 10 solved13 of 40 rungs
  • Secrets, crypto & supply chain2 of 10 solved18 of 40 rungs
  • AI agents0 of 10 solved8 of 40 rungs

Provider performance

Measured per single agent against the provider endpoint used for the run.

Response time
3.48 s median · 6.50 s p95
Output speed
97.0 tok/s
API success rate
99.99%
Input context
56.9K median · 117.4K p95

About this result

Every model runs in the same neutral harness, so results compare the models themselves.

Harness
BB Arena neutral harness
Safety refusals
None

See Hy4 Flash (Max) highlighted on every chart →