AI leaderboard changes June 2024

Confirmed crown changes

• Jun 16, 2024. Embeddings: Intfloat Multilingual E5 Large Instruct and Intfloat E5 Mistral 7B Instruct and Gritlm Gritlm 7B and Gritlm Gritlm 8x7b and Google Text Multilingual Embedding 002 and Salesforce Sfr Embedding 2 R and Alibaba Nlp Gte Qwen2 7B Instruct are co-SOTA. Crown change confirmed by two consecutive snapshots or two independent primary sources. Intfloat Multilingual E5 Large InstructIntfloat E5 Mistral 7B InstructGritlm Gritlm 7BGritlm Gritlm 8x7bGoogle Text Multilingual Embedding 002Salesforce Sfr Embedding 2 RAlibaba Nlp Gte Qwen2 7B Instruct · Embeddings
• Jun 16, 2024. Embeddings: Intfloat Multilingual E5 Large Instruct and Intfloat E5 Mistral 7B Instruct and Gritlm Gritlm 7B and Gritlm Gritlm 8x7b and Salesforce Sfr Embedding 2 R and Alibaba Nlp Gte Qwen2 7B Instruct are co-SOTA. Crown change confirmed by two consecutive snapshots or two independent primary sources. Intfloat Multilingual E5 Large InstructIntfloat E5 Mistral 7B InstructGritlm Gritlm 7BGritlm Gritlm 8x7bSalesforce Sfr Embedding 2 RAlibaba Nlp Gte Qwen2 7B Instruct · Embeddings
• Jun 16, 2024. Embeddings: Intfloat Multilingual E5 Large Instruct and Intfloat E5 Mistral 7B Instruct and Gritlm Gritlm 7B and Salesforce Sfr Embedding 2 R and Alibaba Nlp Gte Qwen2 7B Instruct are co-SOTA. Crown change confirmed by two consecutive snapshots or two independent primary sources. Intfloat Multilingual E5 Large InstructIntfloat E5 Mistral 7B InstructGritlm Gritlm 7BSalesforce Sfr Embedding 2 RAlibaba Nlp Gte Qwen2 7B Instruct · Embeddings
• Jun 7, 2024. Embeddings: Intfloat Multilingual E5 Large Instruct and Intfloat E5 Mistral 7B Instruct and Gritlm Gritlm 7B and Gritlm Gritlm 8x7b and Google Text Multilingual Embedding 002 are co-SOTA. Crown change confirmed by two consecutive snapshots or two independent primary sources. Intfloat Multilingual E5 Large InstructIntfloat E5 Mistral 7B InstructGritlm Gritlm 7BGritlm Gritlm 8x7bGoogle Text Multilingual Embedding 002 · Embeddings

Models that entered the top 3

• Alibaba Nlp Gte Qwen2 7B Instruct at #1 in Embeddings
• Google Text Multilingual Embedding 002 at #1 in Embeddings
• Gritlm Gritlm 7B at #1 in Embeddings
• Gritlm Gritlm 8x7b at #1 in Embeddings
• Intfloat E5 Mistral 7B Instruct at #1 in Embeddings
• Intfloat Multilingual E5 Large Instruct at #1 in Embeddings
• Salesforce Sfr Embedding 2 R at #1 in Embeddings

Benchmarks added or saturated

Benchmark additions for this month are still empty.