MortgageTax
As of Nov 22, 2026, MortgageTax (v1) is maintained by Vals AI. Metric accuracy (%). Ceiling 100. Saturation unknown. Contamination risk low.
- Maintainer
- Vals AI
- Metric
- accuracy (%)
- Ceiling
- 100
- Saturation
- unknown
- Contamination
- low
- Cadence
- Declared cadence: as Vals updates (checked daily). Catalog snapshots: 1, latest Nov 13, 2026.
- Source
- Vals AI · this benchmark on Vals AI
- Grading
- Automatic (tests or exact checks) — Fields extracted from tax-certificate images are checked against labeled answers.
- Partner-built
- Vontive, Together AI
Source: Vals AI. A proprietary private test set run by Vals; scores are republished with permission. Rows are dated the day isitsota first saw them, and only the benchmark's standard harness counts.
What MortgageTax measures
MortgageTax is maintained by Vals AI and reports accuracy (%), where higher is better. The maximum is 100. It keeps a private held-out set. Grading: Automatic (tests or exact checks) (Fields extracted from tax-certificate images are checked against labeled answers.). Built with Vontive and Together AI. Contamination risk is rated low. License: Source: Vals AI. Proprietary private set, run by Vals. Grading: Automatic (tests or exact checks). Fields extracted from tax-certificate images are checked against labeled answers. Partner-built with Vontive, Together AI.
82 models have a current score; the median is 65.5. #1 and #10 are 3.3 apart. The top score is 27.9 below the ceiling.
Where it counts
- Vision — secondary, weight 0.35
Current top scores
- Claude Opus 5 · 72.059 · Nov 13, 2026
- Claude Fable 5.1 · 70.786 · Nov 13, 2026
- Claude Opus 4.7 · 70.27 · Nov 13, 2026
- Claude Sonnet 5 · 70.032 · Nov 13, 2026
- Claude Opus 4.8 · 69.912 · Nov 13, 2026
Who held the top score
- Nov 13, 2026: Claude Opus 5 · 72.1
| Model | Score | Date | Kind |
|---|---|---|---|
| Claude Opus 5 | 72.059 | 2026-11-13 | snapshot |
| Claude Fable 5.1 | 70.786 | 2026-11-13 | snapshot |
| Claude Opus 4.7 | 70.27 | 2026-11-13 | snapshot |
| Claude Sonnet 5 | 70.032 | 2026-11-13 | snapshot |
| Claude Opus 4.8 | 69.912 | 2026-11-13 | snapshot |
| Gemini 3.1 Pro Preview | 69.396 | 2026-11-13 | snapshot |
| Gemini 3 Pro Preview | 69.078 | 2026-11-13 | snapshot |
| Claude Fable 5 | 68.919 | 2026-11-13 | snapshot |
| Gemini 2.5 Pro | 68.918 | 2026-11-13 | snapshot |
| GPT-5.5 | 68.76 | 2026-11-13 | snapshot |
| Gemini 3 Flash Preview | 68.72 | 2026-11-13 | snapshot |
| Gemini 3.5 Flash Lite | 68.68 | 2026-11-13 | snapshot |
| Claude 3.7 Sonnet | 68.68 | 2026-11-13 | snapshot |
| Claude Opus 4.5 | 68.68 | 2026-11-13 | snapshot |
| Claude Opus 4.6 Thinking | 68.522 | 2026-11-13 | snapshot |
| Minimax M3 | 68.362 | 2026-11-13 | snapshot |
| GPT-5.4 | 68.323 | 2026-11-13 | snapshot |
| Qwen3.6 27B | 68.283 | 2026-11-13 | snapshot |
| Gemini 3.5 Flash | 68.124 | 2026-11-13 | snapshot |
| Gemini 3.1 Flash Lite Preview | 68.044 | 2026-11-13 | snapshot |
| Qwen3 6 Plus | 67.965 | 2026-11-13 | snapshot |
| Claude Sonnet 4.6 | 67.726 | 2026-11-13 | snapshot |
| Claude Opus 4.5 20251101 Thinking | 67.686 | 2026-11-13 | snapshot |
| Gemini 3.6 Flash | 67.608 | 2026-11-13 | snapshot |
| Qwen3 5 Flash | 67.368 | 2026-11-13 | snapshot |
| GPT-5.6 Terra | 67.329 | 2026-11-13 | snapshot |
| GPT-5.6 Luna | 67.29 | 2026-11-13 | snapshot |
| GPT-5.6 Sol | 67.289 | 2026-11-13 | snapshot |
| Gemini 2.5 Pro Exp 03.25 | 67.17 | 2026-11-13 | snapshot |
| GPT-5.2 | 67.13 | 2026-11-13 | snapshot |