GPT-5.4 vs Qwen3 8 27B
As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in 5 of 6 shared categories: General LLM, Reasoning, Long context, Factuality, and Abstraction (ARC).
GPT-5.4
It used to be. Was SOTA in General LLM.
Qwen3 8 27B
Yes. Yes on Reasoning (≤32B); Coding › Web dev (≤32B). Not the overall leader.
| Category | GPT-5.4 | Qwen3 8 27B |
|---|---|---|
| General LLM | #30 · Was SOTA · General LLM Margin 15.957446808510639 LMArena leaderboard dataset · Oct 13, 2026 | #90 · #90 in General LLM Margin 47.87234042553192 LMArena leaderboard dataset · Oct 13, 2026 |
| Reasoning | #32 · #32 in Reasoning Margin 17.55319148936171 LMArena leaderboard dataset · Oct 13, 2026 | #84 · #84 in Reasoning Margin 45.212765957446805 LMArena leaderboard dataset · Oct 13, 2026 |
| Math | #9 · #9 in Math Margin 17.777777777777757 Epoch AI benchmarking hub · Mar 5, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 |
| Science | #16 · #16 in Science Margin — Epoch AI benchmarking hub · Mar 5, 2026 | — |
| Coding | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 |
| Coding › Web dev | #60 · #60 in Coding › Web dev Margin 47.2 LMArena leaderboard dataset · Oct 13, 2026 | #26 · #26 in Coding › Web dev Margin 20 LMArena leaderboard dataset · Oct 13, 2026 |
| Long context | #40 · #40 in Long context Margin 21.276595744680847 LMArena leaderboard dataset · Oct 13, 2026 | #92 · #92 in Long context Margin 48.93617021276596 LMArena leaderboard dataset · Oct 13, 2026 |
| Vision | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 9, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 9, 2026 |
| Factuality | #6 · Was SOTA · Factuality Margin 4.0697674418604635 LMArena leaderboard dataset · Oct 13, 2026 | #86 · #86 in Factuality Margin 50.58139534883721 LMArena leaderboard dataset · Oct 13, 2026 |
| Abstraction (ARC) | #10 · #10 in Abstraction (ARC) Margin — Epoch AI benchmarking hub · Mar 5, 2026 | #20 · #20 in Abstraction (ARC) Margin — Epoch AI benchmarking hub · Aug 14, 2026 |
GPT-5.4: $5.625 per 1M blended tokens.
Qwen3 8 27B: $0.73 per 1M blended tokens.
GPT-5.4: closed weights.
Qwen3 8 27B: open weights.
General LLM: As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in General LLM at #30 against #90.
Reasoning: As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in Reasoning at #32 against #84.
Coding › Web dev: As of Oct 15, 2026, Qwen3 8 27B leads GPT-5.4 in Coding › Web dev at #26 against #60.
Long context: As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in Long context at #40 against #92.
Factuality: As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in Factuality at #6 against #86.
Abstraction (ARC): As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in Abstraction (ARC) at #10 against #20.
GPT-5.4 or Qwen3 8 27B?
As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in 5 of 6 shared categories: General LLM, Reasoning, Long context, Factuality, and Abstraction (ARC).
GPT-5.4 or Qwen3 8 27B for General LLM?
As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in General LLM at #30 against #90.
GPT-5.4 or Qwen3 8 27B for Reasoning?
As of Oct 15, 2026, GPT-5.4 leads Qwen3 8 27B in Reasoning at #32 against #84.
GPT-5.4 or Qwen3 8 27B for Coding › Web dev?
As of Oct 15, 2026, Qwen3 8 27B leads GPT-5.4 in Coding › Web dev at #26 against #60.