Gemini 1.5 Pro 002 vs Llama 3.1 405B Instruct
As of Oct 14, 2026, Gemini 1.5 Pro 002 leads Llama 3.1 405B Instruct in 1 of 2 shared categories: Science.
Gemini 1.5 Pro 002
It used to be. Was SOTA in Math.
Llama 3.1 405B Instruct
It used to be. Was SOTA in General LLM.
| Category | Gemini 1.5 Pro 002 | Llama 3.1 405B Instruct |
|---|---|---|
| General LLM | #11 · #11 in General LLM Margin — LMArena leaderboard dataset · Mar 3, 2025 | #3 · #3 in General LLM Margin — LMArena leaderboard dataset · Sep 4, 2024 |
| Reasoning | #— · Not enough data Margin — LMArena leaderboard dataset · Feb 17, 2025 | #— · Not enough data Margin — LMArena leaderboard dataset · Sep 4, 2024 |
| Math | #40 · Was SOTA · Math Margin 88.88888888888889 Epoch AI benchmarking hub · Sep 24, 2024 | — |
| Science | #111 · #111 in Science Margin — Epoch AI benchmarking hub · Sep 24, 2024 | #124 · #124 in Science Margin — Epoch AI benchmarking hub · Jul 23, 2024 |
| Coding | #— · Not enough data Margin — LMArena leaderboard dataset · Dec 10, 2024 | — |
| Long context | #— · Not enough data Margin — LMArena leaderboard dataset · Feb 27, 2025 | — |
| Vision | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 9, 2026 | — |
Gemini 1.5 Pro 002: price per 1M tokens is unset in the catalog.
Llama 3.1 405B Instruct: price per 1M tokens is unset in the catalog.
Gemini 1.5 Pro 002: closed weights.
Llama 3.1 405B Instruct: open weights.
General LLM: As of Oct 14, 2026, Llama 3.1 405B Instruct leads Gemini 1.5 Pro 002 in General LLM at #3 against #11.
Science: As of Oct 14, 2026, Gemini 1.5 Pro 002 leads Llama 3.1 405B Instruct in Science at #111 against #124.
Gemini 1.5 Pro 002 · Llama 3.1 405B Instruct
Gemini 1.5 Pro 002 or Llama 3.1 405B Instruct?
As of Oct 14, 2026, Gemini 1.5 Pro 002 leads Llama 3.1 405B Instruct in 1 of 2 shared categories: Science.
Gemini 1.5 Pro 002 or Llama 3.1 405B Instruct for General LLM?
As of Oct 14, 2026, Llama 3.1 405B Instruct leads Gemini 1.5 Pro 002 in General LLM at #3 against #11.
Gemini 1.5 Pro 002 or Llama 3.1 405B Instruct for Science?
As of Oct 14, 2026, Gemini 1.5 Pro 002 leads Llama 3.1 405B Instruct in Science at #111 against #124.