Sign in
Compare · 2026-10-15

GPT-5.4 vs Kimi K2 0905 Preview

As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in 4 of 4 shared categories: General LLM, Reasoning, Long context, and Factuality.

CategoryGPT-5.4Kimi K2 0905 Preview
General LLM
#30 · Was SOTA · General LLM
Margin 15.957446808510639
LMArena leaderboard dataset · Oct 13, 2026
#120 · #120 in General LLM
Margin 63.829787234042556
LMArena leaderboard dataset · Oct 13, 2026
Reasoning
#32 · #32 in Reasoning
Margin 17.55319148936171
LMArena leaderboard dataset · Oct 13, 2026
#122 · #122 in Reasoning
Margin 65.42553191489361
LMArena leaderboard dataset · Oct 13, 2026
Math
#9 · #9 in Math
Margin 17.777777777777757
Epoch AI benchmarking hub · Mar 5, 2026
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 13, 2026
Science
#16 · #16 in Science
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
—
Coding
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 13, 2026
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 13, 2026
Coding › Web dev
#60 · #60 in Coding › Web dev
Margin 47.2
LMArena leaderboard dataset · Oct 13, 2026
—
Long context
#40 · #40 in Long context
Margin 21.276595744680847
LMArena leaderboard dataset · Oct 13, 2026
#151 · #151 in Long context
Margin 80.31914893617021
LMArena leaderboard dataset · Oct 13, 2026
Vision
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 9, 2026
—
Factuality
#6 · Was SOTA · Factuality
Margin 4.0697674418604635
LMArena leaderboard dataset · Oct 13, 2026
#140 · #140 in Factuality
Margin 81.97674418604652
LMArena leaderboard dataset · Oct 13, 2026
Abstraction (ARC)
#10 · #10 in Abstraction (ARC)
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
—
Price per 1M tokens

GPT-5.4: $5.625 per 1M blended tokens.

Kimi K2 0905 Preview: price per 1M tokens is unset in the catalog.

Open weights

GPT-5.4: closed weights.

Kimi K2 0905 Preview: open weights.

Which to pick

General LLM: As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in General LLM at #30 against #120.

Reasoning: As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in Reasoning at #32 against #122.

Long context: As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in Long context at #40 against #151.

Factuality: As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in Factuality at #6 against #140.

GPT-5.4 · Kimi K2 0905 Preview

GPT-5.4 or Kimi K2 0905 Preview?

As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in 4 of 4 shared categories: General LLM, Reasoning, Long context, and Factuality.

GPT-5.4 or Kimi K2 0905 Preview for General LLM?

As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in General LLM at #30 against #120.

GPT-5.4 or Kimi K2 0905 Preview for Reasoning?

As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in Reasoning at #32 against #122.

GPT-5.4 or Kimi K2 0905 Preview for Long context?

As of Oct 15, 2026, GPT-5.4 leads Kimi K2 0905 Preview in Long context at #40 against #151.