Sign in
VERIFIEDNov 222026

Is Raw Qwen3 8B direct logits state of the art?#414Best current rank: #414 in Decision models, as of Nov 22, 2026.

As of Nov 22, 2026, Raw Qwen3 8B direct logits is ranked #414 in Decision models (since Nov 22, 2026; sources JevBench; methodology v1.0). Ranked #414 in Decision models.

Computed automaticallyas of Nov 22, 2026methodology v1.0confidence: medium
View as of point-in-time crowns
At a glance

Facts and scores

Raw Qwen3 8B direct logits is an open-weights (Apache-2.0) text model from Alibaba / Qwen; 8B parameters and no public price.

How it scores

  • On JevBench price it scores 6.5%, #106 of 134 (top 80%); 6.4 pts behind verdict-small (Manavarya09, multilingual-e5-small 118M); level with Qwen3.5-9B Jev-like data-mix v2 above and system-one (Qwen3-8B, Sean Goedecke) is 0.3 pts below.
  • On JevBench it scores 30.1 (CI 29.6–30.6), #123 of 134 (top 92%); 52.7 behind Perplexity Decider v1.1 27B (Qwen3.8-27B, noncausal decision readout); Open Jev JSON Canvas (JoshuaSP) is 0.5 above and system-one (Qwen3-8B, Sean Goedecke) is 0.4 below.

History

First result on isitsota: Oct 8, 2026. Best overall rank so far: #414 in Decision models, first held Nov 22, 2026.

$0.0654 per 1,000 decisions.

Receipts

Evidence

Scores come from the latest ingested snapshot
SourceScoreDateTypeReceipt
JevBench
Raw Qwen3 8B direct logits
30.1 29.6–30.62026-10-08INDEP.snap_jevbench_2026-10-08_v1.6.1|jevbench-v1.6.1
Reign history

Where it sits in the succession

Full timeline →

Crown intervals for this model are still empty.

Honest about the gaps

Where it is not the crown

CategoryThis modelRankLeader
Decision models#414 in this category#414karpo-decision-31B
Links

Related pages

Is Raw Qwen3 8B direct logits SOTA?

Best current rank: #414 in Decision models, as of Nov 22, 2026.

What is Raw Qwen3 8B direct logits best at?

As of Nov 22, 2026, Raw Qwen3 8B direct logits is ranked #414 in Decision models (since Nov 22, 2026; sources JevBench).