# Is ERNIE-5.5-Flash-Base SOTA?

Pending benchmarks. Announced Nov 5, 2026; no independent results yet.

As of Nov 22, 2026, ERNIE-5.5-Flash-Base is pending benchmarks on isitsota: announced Nov 5, 2026, with no independent results on the boards we track yet.

Baidu's open-weight pre-training checkpoint for ERNIE 5.5 Flash: a sparse MoE language model with 280B total parameters and 14B activated per token, pre-trained from scratch on 33.5T tokens with a training context of up to 128K (fine-tuning and inference support 1M). It is the raw base before mid- or post-training. FP8 and BF16 safetensors on Hugging Face and ModelScope under the ERNIE 5.5 Flash Base Model License Agreement v1.0. Serving paths documented for SGLang and vLLM; no Baidu-hosted API stated for this checkpoint.

Canonical: https://isitsota.com/m/ernie-5-5-flash-base
Last updated: 2026-11-05
Tracking since: 2026-11-05

## Announced facts

| Fact | Value |
| --- | --- |
| Lab | Baidu |
| Announced | Nov 5, 2026 |
| API | Not yet · No Baidu-hosted API stated for this base checkpoint |
| Open weights | Published |
| Parameters | 280B total / 14B active |
| Role | Pre-training-end base checkpoint before mid- or post-training; starting point for domain adaptation, instruction tuning and RL research |
| Architecture | 43-layer hybrid-attention MoE: 1 dense FFN + 42 Multi-Router Latent MoE layers; 37 Heavily Compressed Attention layers and 6 MLA+DSA layers; 512 routed experts (top-10) plus 1 shared expert per MoE layer; mHC, MultiMax head, ECHO (final layer as draft/MTP replacement); ~200K BPE tokenizer |
| Context | 128K max training context; fine-tuning and inference support up to 1M tokens |
| Pre-training | 33.5T tokens from scratch; Muon optimizer; FP8 pre-training; emphasis on repository-scale code and long context |
| Checkpoints | FP8 (baidu/ERNIE-5.5-Flash-Base) and BF16 (baidu/ERNIE-5.5-Flash-Base-BF16) on Hugging Face and ModelScope |
| Serving | SGLang (prebuilt ernie-55-flash image) and vLLM with the baidu/vLLM-ERNIE plugin; Transformers tag on the model card |
| License | ERNIE 5.5 Flash Base Model License Agreement v1.0 (Hugging Face license tag: other) |
| Related models | Separate from Ernie 5.1 and Ernie 5.0 API snapshots; post-trained ERNIE 5.5 Flash not released yet |

Tags marked unsure are not stated on the lab's own pages.

## What would let us call it

Verdicts use only independent boards we already track. Two consecutive snapshots are required before any crown.

- [x] Publicly announced with a source
- [x] Usable by the public (API or weights)
- [ ] Listed on an independent board we track
- [ ] Enough results for a rank in a category
- [ ] Holds across two snapshots (crowns only)

## What the lab claims

Self-reported. Shown for context; not used in any verdict.

- Lab claim: the post-trained ERNIE 5.5 Flash is coming soon.
- Lab claim: matches SOTA at its size (Baidu Research).
- Lab claim: under Baidu's unified evaluation pipeline against similarly sized base models (DeepSeek-V4-Flash-Base, Hy3-preview-Base, MiMo-V2.5-Base), it reports strong results across knowledge, reasoning, math, code, multilingual and long-context benchmarks (full table on the model card and blog).

## Sources

- LAB: [ERNIE 5.5 Flash Base technical blog (Baidu ERNIE)](https://ernie.baidu.com/release/ernie-5-5-flash-base/) (2026-11-05)
- REPO: [baidu/ERNIE-5.5-Flash-Base model card (Hugging Face)](https://huggingface.co/baidu/ERNIE-5.5-Flash-Base)
- REPO: [baidu/ERNIE-5.5-Flash-Base-BF16 model card (Hugging Face)](https://huggingface.co/baidu/ERNIE-5.5-Flash-Base-BF16)
- LAB: [Baidu Research announcement on X](https://x.com/BaiduResearch/status/2118249227939967424) (2026-11-05)
- LAB: [Baidu ERNIE announcement on X](https://x.com/Baidu_ERNIE/status/2118342822516437115) (2026-11-05)

Tracking continues until an independent board lists it.

## Related

- Lab: [Baidu](https://isitsota.com/labs/baidu.md)
- All pending releases: https://isitsota.com/releases.md
- JSON: https://api.isitsota.com/v1/models/ernie-5-5-flash-base
