Claude 3.5 Haiku
Claude 3.5 Haiku is an API-only (closed weights) language model from Anthropic, released October 22, 2024. On the Epoch Capabilities Index it scores 124.9, rank 174 of 256 rated models.
Check it against your own PC →
Lab
Anthropic
Released
October 22, 2024
Weights
API-only (closed weights)
Parameters
–
Context
–
Price / M tokens
–
Epoch ECI
124.9 #174
Strengths by category
ModelTape's 0–100 fit on Epoch AI benchmark results.
| Category | Score | Based on |
|---|---|---|
| Math | 12.1 | MATH level 5, OTIS Mock AIME 2024-2025, FrontierMath-2025-02-28-Private |
| Knowledge | 26.0 | GPQA diamond, MMLU |
Benchmark results
| Benchmark (Epoch AI) | Score |
|---|---|
| MMLU | 65.7% |
| MATH level 5 | 46.4% |
| Aider Polyglot | 28.0% |
| Balrog | 19.3% |
| GPQA Diamond | 18.2% |
| OTIS Mock AIME | 4.2% |
| FrontierMath-2025-02-28-Private | 0.6% |
Links
Models with a similar score
GPT-4o (Nov 2024) · GPT-4o (May 2024) · Llama 3.1-405B · Llama 4 Scout · Gemma 3 27B · Qwen2.5-72B · GPT-4o (Aug 2024) · Gemini 1.5 Flash (Sep 2024)
More from Anthropic
Claude Fable 5.2 · Claude Haiku 5.5 · Claude Sonnet 5.5 · Claude Opus 5.5 · Claude Fable 5.1 · Claude Opus 5 · Claude Sonnet 5 · Claude Fable 5