Compare · 2026-10-14

Gemma 3 27B IT vs GPT-5.4

As of Oct 14, 2026, Gemma 3 27B IT leads GPT-5.4 in 0 of 3 shared categories.

CategoryGemma 3 27B ITGPT-5.4
General LLM
#146 · #146 in General LLM
Margin 99.31972789115646
LMArena leaderboard dataset · Oct 13, 2026
#28 · Was SOTA · General LLM
Margin 19.04761904761905
LMArena leaderboard dataset · Oct 13, 2026
Reasoning
#— · Not enough data
Margin —
Epoch AI benchmarking hub · Mar 12, 2025
#29 · #29 in Reasoning
Margin 20.54794520547945
LMArena leaderboard dataset · Oct 13, 2026
Math—
#9 · #9 in Math
Margin 17.777777777777757
Epoch AI benchmarking hub · Mar 5, 2026
Science
#132 · #132 in Science
Margin —
Epoch AI benchmarking hub · Mar 12, 2025
#16 · #16 in Science
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
Coding—
#— · Not enough data
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
Coding › Web dev—
#55 · #55 in Coding › Web dev
Margin 50.467289719626166
LMArena leaderboard dataset · Oct 13, 2026
Long context—
#34 · #34 in Long context
Margin 23.12925170068027
LMArena leaderboard dataset · Oct 13, 2026
Vision
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 9, 2026
#— · Not enough data
Margin —
LMArena leaderboard dataset · Oct 9, 2026
Factuality
#115 · #115 in Factuality
Margin 86.56716417910448
LMArena leaderboard dataset · Oct 13, 2026
#6 · Was SOTA · Factuality
Margin 5.22388059701494
LMArena leaderboard dataset · Oct 13, 2026
Abstraction (ARC)—
#10 · #10 in Abstraction (ARC)
Margin —
Epoch AI benchmarking hub · Mar 5, 2026
Price per 1M tokens

Gemma 3 27B IT: $0.1725 per 1M blended tokens.

GPT-5.4: $5.625 per 1M blended tokens.

Open weights

Gemma 3 27B IT: closed weights.

GPT-5.4: closed weights.

Which to pick

General LLM: As of Oct 14, 2026, GPT-5.4 leads Gemma 3 27B IT in General LLM at #28 against #146.

Science: As of Oct 14, 2026, GPT-5.4 leads Gemma 3 27B IT in Science at #16 against #132.

Factuality: As of Oct 14, 2026, GPT-5.4 leads Gemma 3 27B IT in Factuality at #6 against #115.

Gemma 3 27B IT · GPT-5.4

Gemma 3 27B IT or GPT-5.4?

As of Oct 14, 2026, Gemma 3 27B IT leads GPT-5.4 in 0 of 3 shared categories.

Gemma 3 27B IT or GPT-5.4 for General LLM?

As of Oct 14, 2026, GPT-5.4 leads Gemma 3 27B IT in General LLM at #28 against #146.

Gemma 3 27B IT or GPT-5.4 for Science?

As of Oct 14, 2026, GPT-5.4 leads Gemma 3 27B IT in Science at #16 against #132.

Gemma 3 27B IT or GPT-5.4 for Factuality?

As of Oct 14, 2026, GPT-5.4 leads Gemma 3 27B IT in Factuality at #6 against #115.