GPT-5.4 Mini vs Llama 3.1 405B Instruct
As of Oct 14, 2026, GPT-5.4 Mini leads Llama 3.1 405B Instruct in 1 of 2 shared categories: Science.
GPT-5.4 Mini
#36 Best recorded rank: #36 in Abstraction (ARC), as of Oct 14, 2026.
Llama 3.1 405B Instruct
It used to be. Was SOTA in General LLM.
| Category | GPT-5.4 Mini | Llama 3.1 405B Instruct |
|---|---|---|
| General LLM | #59 · #59 in General LLM Margin 40.136054421768705 LMArena leaderboard dataset · Oct 13, 2026 | #3 · #3 in General LLM Margin — LMArena leaderboard dataset · Sep 4, 2024 |
| Reasoning | #59 · #59 in Reasoning Margin 41.0958904109589 LMArena leaderboard dataset · Oct 13, 2026 | #— · Not enough data Margin — LMArena leaderboard dataset · Sep 4, 2024 |
| Math | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 | — |
| Science | #52 · #52 in Science Margin — Epoch AI benchmarking hub · Mar 17, 2026 | #124 · #124 in Science Margin — Epoch AI benchmarking hub · Jul 23, 2024 |
| Coding | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 13, 2026 | — |
| Coding › Web dev | #74 · #74 in Coding › Web dev Margin 68.22429906542055 LMArena leaderboard dataset · Oct 13, 2026 | — |
| Long context | #71 · #71 in Long context Margin 48.29931972789117 LMArena leaderboard dataset · Oct 13, 2026 | — |
| Vision | #— · Not enough data Margin — LMArena leaderboard dataset · Oct 9, 2026 | — |
| Factuality | #54 · #54 in Factuality Margin 41.04477611940298 LMArena leaderboard dataset · Oct 13, 2026 | — |
| Abstraction (ARC) | #36 · #36 in Abstraction (ARC) Margin — Epoch AI benchmarking hub · Mar 17, 2026 | — |
GPT-5.4 Mini: $1.6875 per 1M blended tokens.
Llama 3.1 405B Instruct: price per 1M tokens is unset in the catalog.
GPT-5.4 Mini: closed weights.
Llama 3.1 405B Instruct: open weights.
General LLM: As of Oct 14, 2026, Llama 3.1 405B Instruct leads GPT-5.4 Mini in General LLM at #3 against #59.
Science: As of Oct 14, 2026, GPT-5.4 Mini leads Llama 3.1 405B Instruct in Science at #52 against #124.
GPT-5.4 Mini · Llama 3.1 405B Instruct
GPT-5.4 Mini or Llama 3.1 405B Instruct?
As of Oct 14, 2026, GPT-5.4 Mini leads Llama 3.1 405B Instruct in 1 of 2 shared categories: Science.
GPT-5.4 Mini or Llama 3.1 405B Instruct for General LLM?
As of Oct 14, 2026, Llama 3.1 405B Instruct leads GPT-5.4 Mini in General LLM at #3 against #59.
GPT-5.4 Mini or Llama 3.1 405B Instruct for Science?
As of Oct 14, 2026, GPT-5.4 Mini leads Llama 3.1 405B Instruct in Science at #52 against #124.