Sign in

Is Raw Qwen3 4B Instruct 2507 direct logits SOTA in Decision models?#389 in Decision modelsRanked #389 in Decision models.

How it scores here

Raw Qwen3 4B Instruct 2507 direct logits in Decision models

Primary benchmarks

  • JevBench: 34.6 (CI 34.1–35.1) on Oct 8, 2026 (#116 of 134).

On the category's weighted score it is 86.4 points behind #1 karpo-decision-31B and 0.3 behind the next model up, Bekko System One v0 400M.

Nearby on the board

#ModelCategory score
386Raw Phi-4 mini direct logits14.4
387Crivo-150M v214.2
388Bekko System One v0 400M13.9
389Raw Qwen3 4B Instruct 2507 direct logits13.6
390Mola-150M13.6
391vLLM-SR d3-edge (0.6B)13.3
392Mola-68M13.0
Standings

Decision models

Category page →