Claude Sonnet 4 20250514 vs Gemini 3.1 Pro Preview
As of Oct 14, 2026, Claude Sonnet 4 20250514 leads Gemini 3.1 Pro Preview in 0 of 2 shared categories.
Claude Sonnet 4 20250514
#49 Best recorded rank: #49 in Abstraction (ARC), as of Oct 14, 2026.
Gemini 3.1 Pro Preview
Yes. Yes on Math (best per dollar). Not the overall leader.
| Category | Claude Sonnet 4 20250514 | Gemini 3.1 Pro Preview |
|---|---|---|
| General LLM | — | #15 · Was SOTA · General LLM Margin 10.204081632653057 LMArena leaderboard dataset · Oct 13, 2026 |
| Reasoning | #— · Not enough data Margin — Epoch AI benchmarking hub · May 22, 2025 | #14 · Was SOTA · Reasoning Margin 10.273972602739732 LMArena leaderboard dataset · Oct 13, 2026 |
| Math | — | #3 · Near-SOTA · Math Margin 4.444444444444443 Epoch AI benchmarking hub · Feb 19, 2026 |
| Science | #74 · #74 in Science Margin — Epoch AI benchmarking hub · May 22, 2025 | #7 · #7 in Science Margin — Epoch AI benchmarking hub · Feb 19, 2026 |
| Coding | — | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 |
| Coding › Web dev | — | #58 · #58 in Coding › Web dev Margin 53.271028037383175 LMArena leaderboard dataset · Oct 13, 2026 |
| Long context | — | #12 · Was SOTA · Long context Margin 8.163265306122454 LMArena leaderboard dataset · Oct 13, 2026 |
| Vision | — | #25 · Was SOTA · Vision Margin 68.42105263157896 Epoch AI benchmarking hub · Feb 19, 2026 |
| Factuality | — | #18 · #18 in Factuality Margin 14.179104477611943 LMArena leaderboard dataset · Oct 13, 2026 |
| Abstraction (ARC) | #49 · #49 in Abstraction (ARC) Margin — Epoch AI benchmarking hub · May 22, 2025 | #2 · #2 in Abstraction (ARC) Margin — Epoch AI benchmarking hub · Feb 19, 2026 |
Claude Sonnet 4 20250514: price per 1M tokens is unset in the catalog.
Gemini 3.1 Pro Preview: $4.5 per 1M blended tokens.
Claude Sonnet 4 20250514: closed weights.
Gemini 3.1 Pro Preview: closed weights.
Science: As of Oct 14, 2026, Gemini 3.1 Pro Preview leads Claude Sonnet 4 20250514 in Science at #7 against #74.
Abstraction (ARC): As of Oct 14, 2026, Gemini 3.1 Pro Preview leads Claude Sonnet 4 20250514 in Abstraction (ARC) at #2 against #49.
Claude Sonnet 4 20250514 · Gemini 3.1 Pro Preview
Claude Sonnet 4 20250514 or Gemini 3.1 Pro Preview?
As of Oct 14, 2026, Claude Sonnet 4 20250514 leads Gemini 3.1 Pro Preview in 0 of 2 shared categories.
Claude Sonnet 4 20250514 or Gemini 3.1 Pro Preview for Science?
As of Oct 14, 2026, Gemini 3.1 Pro Preview leads Claude Sonnet 4 20250514 in Science at #7 against #74.
Claude Sonnet 4 20250514 or Gemini 3.1 Pro Preview for Abstraction (ARC)?
As of Oct 14, 2026, Gemini 3.1 Pro Preview leads Claude Sonnet 4 20250514 in Abstraction (ARC) at #2 against #49.