GPT-5.4 vs Qwen3 5 397B A17b
As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in 6 of 6 shared categories: General LLM, Reasoning, Science, Coding › Web dev, Long context, and Factuality.
GPT-5.4
It used to be. Was SOTA in General LLM.
Qwen3 5 397B A17b
#53 Best recorded rank: #53 in Science, as of Oct 14, 2026.
| Category | GPT-5.4 | Qwen3 5 397B A17b |
|---|---|---|
| General LLM | #28 · Was SOTA · General LLM Margin 19.04761904761905 LMArena leaderboard dataset · Oct 13, 2026 | #66 · #66 in General LLM Margin 44.89795918367347 LMArena leaderboard dataset · Oct 13, 2026 |
| Reasoning | #29 · #29 in Reasoning Margin 20.54794520547945 LMArena leaderboard dataset · Oct 13, 2026 | #64 · #64 in Reasoning Margin 44.52054794520548 LMArena leaderboard dataset · Oct 13, 2026 |
| Math | #9 · #9 in Math Margin 17.777777777777757 Epoch AI benchmarking hub · Mar 5, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 |
| Science | #16 · #16 in Science Margin — Epoch AI benchmarking hub · Mar 5, 2026 | #53 · #53 in Science Margin — Epoch AI benchmarking hub · Feb 13, 2026 |
| Coding | #— · Not enough data Margin — Epoch AI benchmarking hub · Mar 5, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 |
| Coding › Web dev | #55 · #55 in Coding › Web dev Margin 50.467289719626166 LMArena leaderboard dataset · Oct 13, 2026 | #72 · #72 in Coding › Web dev Margin 66.35514018691589 LMArena leaderboard dataset · Oct 13, 2026 |
| Long context | #34 · #34 in Long context Margin 23.12925170068027 LMArena leaderboard dataset · Oct 13, 2026 | #60 · #60 in Long context Margin 40.81632653061225 LMArena leaderboard dataset · Oct 13, 2026 |
| Vision | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 9, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 9, 2026 |
| Factuality | #6 · Was SOTA · Factuality Margin 5.22388059701494 LMArena leaderboard dataset · Oct 13, 2026 | #59 · #59 in Factuality Margin 44.776119402985074 LMArena leaderboard dataset · Oct 13, 2026 |
| Abstraction (ARC) | #10 · #10 in Abstraction (ARC) Margin — Epoch AI benchmarking hub · Mar 5, 2026 | — |
GPT-5.4: $5.625 per 1M blended tokens.
Qwen3 5 397B A17b: $1.2750000000000001 per 1M blended tokens.
GPT-5.4: closed weights.
Qwen3 5 397B A17b: open weights.
General LLM: As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in General LLM at #28 against #66.
Reasoning: As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Reasoning at #29 against #64.
Science: As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Science at #16 against #53.
Coding › Web dev: As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Coding › Web dev at #55 against #72.
Long context: As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Long context at #34 against #60.
Factuality: As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Factuality at #6 against #59.
GPT-5.4 or Qwen3 5 397B A17b?
As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in 6 of 6 shared categories: General LLM, Reasoning, Science, Coding › Web dev, Long context, and Factuality.
GPT-5.4 or Qwen3 5 397B A17b for General LLM?
As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in General LLM at #28 against #66.
GPT-5.4 or Qwen3 5 397B A17b for Reasoning?
As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Reasoning at #29 against #64.
GPT-5.4 or Qwen3 5 397B A17b for Science?
As of Oct 14, 2026, GPT-5.4 leads Qwen3 5 397B A17b in Science at #16 against #53.