Sign in
Compare · 2026-10-15

GPT-5.4 vs Mistral Medium 2505

As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in 5 of 5 shared categories: General LLM, Reasoning, Math, Science, and Long context.

CategoryGPT-5.4Mistral Medium 2505
General LLM
#30 · Was SOTA · General LLM
Margin 15.957446808510639
LMArena leaderboard dataset · Oct 13, 2026
#169 · #169 in General LLM
Margin 89.8936170212766
LMArena leaderboard dataset · Oct 13, 2026
Reasoning
#32 · #32 in Reasoning
Margin 17.55319148936171
LMArena leaderboard dataset · Oct 13, 2026
#173 · #173 in Reasoning
Margin 92.55319148936171
LMArena leaderboard dataset · Oct 13, 2026
Math
#9 · #9 in Math
Margin 17.777777777777757
Epoch AI benchmarking hub · Mar 5, 2026
#41 · #41 in Math
Margin 91.11111111111111
Epoch AI benchmarking hub · May 7, 2025
Science
#16 · #16 in Science
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
#110 · #110 in Science
Margin —
Epoch AI benchmarking hub · May 7, 2025
Coding
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 13, 2026
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 13, 2026
Coding › Web dev
#60 · #60 in Coding › Web dev
Margin 47.2
LMArena leaderboard dataset · Oct 13, 2026
—
Long context
#40 · #40 in Long context
Margin 21.276595744680847
LMArena leaderboard dataset · Oct 13, 2026
#166 · #166 in Long context
Margin 88.29787234042553
LMArena leaderboard dataset · Oct 13, 2026
Vision
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 9, 2026
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 9, 2026
Factuality
#6 · Was SOTA · Factuality
Margin 4.0697674418604635
LMArena leaderboard dataset · Oct 13, 2026
—
Abstraction (ARC)
#10 · #10 in Abstraction (ARC)
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
—
Price per 1M tokens

GPT-5.4: $5.625 per 1M blended tokens.

Mistral Medium 2505: price per 1M tokens is unset in the catalog.

Open weights

GPT-5.4: closed weights.

Mistral Medium 2505: closed weights.

Which to pick

General LLM: As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in General LLM at #30 against #169.

Reasoning: As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in Reasoning at #32 against #173.

Math: As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in Math at #9 against #41.

Science: As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in Science at #16 against #110.

Long context: As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in Long context at #40 against #166.

GPT-5.4 · Mistral Medium 2505

GPT-5.4 or Mistral Medium 2505?

As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in 5 of 5 shared categories: General LLM, Reasoning, Math, Science, and Long context.

GPT-5.4 or Mistral Medium 2505 for General LLM?

As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in General LLM at #30 against #169.

GPT-5.4 or Mistral Medium 2505 for Reasoning?

As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in Reasoning at #32 against #173.

GPT-5.4 or Mistral Medium 2505 for Math?

As of Oct 15, 2026, GPT-5.4 leads Mistral Medium 2505 in Math at #9 against #41.