Recap · 2024-08
AI leaderboard changes August 2024
As of Aug 28, 2024, 4 confirmed crown changes are recorded for August 2024.
Crowns
Confirmed crown changes
- Aug 28, 2024. Reasoning: Claude 3.5 Sonnet takes the crown. First holder recorded for this category and slice. Claude 3.5 Sonnet · Reasoning
- Aug 28, 2024. General LLM: GPT-4O and Claude 3.5 Sonnet are co-SOTA. First holder recorded for this category and slice. GPT-4OClaude 3.5 Sonnet · General LLM
- Aug 28, 2024. Reasoning: Llama 3.1 405B Instruct takes the crown. First holder recorded for this category and slice. Llama 3.1 405B Instruct · Reasoning
- Aug 28, 2024. General LLM: Llama 3.1 405B Instruct takes the crown. First holder recorded for this category and slice. Llama 3.1 405B Instruct · General LLM
Top 3
Models that entered the top 3
- Claude 3.5 Sonnet at #1 in General LLM
- Claude 3.5 Sonnet at #1 in Reasoning
- GPT-4O at #1 in General LLM
Benchmarks
Benchmarks added or saturated
Benchmark additions for this month are still empty.