ModelTape
All modelsNew releasesRankingsRuns on my GPUOpen the app →
ModelTape / Models / Llama 3.3 70B
Meta · open-weights

Llama 3.3 70B

Llama 3.3 70B is an open-weights language model from Meta, released December 6, 2024. It has 70B parameters (dense). On the Epoch Capabilities Index it scores 126.1, rank 170 of 256 rated models.

Check it against your own PC →

Lab
Meta
Released
December 6, 2024
Weights
Open restricted use
Parameters
70B dense
Context
–
Price / M tokens
–
Epoch ECI
126.1 #170

Can you run Llama 3.3 70B locally?

The smallest common GPU it runs on is 24 GB of VRAM (with 32 GB of RAM): IQ2_XXS, fully on GPU, roughly 30 tokens per second. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.

GPU memoryVerdictBest quantVRAMRAMtok/s
6 GB VRAMVery slowIQ2_XXS (heavy loss)5.2 GB17.8 GB~2
8 GB VRAMVery slowIQ2_XXS (heavy loss)7.2 GB15.8 GB~2
12 GB VRAMVery slowIQ2_XXS (heavy loss)11.2 GB11.8 GB~2
16 GB VRAMVery slowIQ2_XXS (heavy loss)15.2 GB7.8 GB~3
24 GB VRAMRuns on GPUIQ2_XXS (heavy loss)23.0 GB–~30
32 GB VRAMRuns on GPUIQ2_M (heavy loss)28.6 GB–~44

Strengths by category

ModelTape's 0–100 fit on Epoch AI benchmark results.

CategoryScoreBased on
Math12.2MATH level 5, OTIS Mock AIME 2024-2025
Knowledge34.3GPQA diamond, MMLU

Benchmark results

Benchmark (Epoch AI)Score
MMLU81.7%
MATH level 541.6%
GPQA Diamond31.2%
Balrog23.0%
OTIS Mock AIME5.0%
SimpleBench3.9%

Links

Epoch AI benchmarks

Models with a similar score

Claude 3.5 Sonnet · Grok-2 (Dec 2024) · Phi-4 · GPT-4o (Nov 2024) · GPT-4o (May 2024) · Llama 3.1-405B · Llama 4 Scout · Gemma 3 27B

More from Meta

Muse Ember · Muse Spark Open · Muse Wonder · Muse Wonder Full · Muse Spark 1.3 · Muse Spark 1.3 Contributor · Muse Glimmer · Muse Glimmer 30B assistant

Data updated Thu, 12 Nov 2026 09:42 UTC. Benchmarks, Capabilities Index and model announcements: Epoch AI, “Capabilities & benchmarking” and “Data on AI models” (CC BY 4.0); category scores are ModelTape's own fit on Epoch's results. Releases and prices: models.dev (MIT). Sizes and quantizations: Hugging Face. “Runs on” figures are estimates from model size, quantization and memory bandwidth (±30–50%).
Live app · All models · New releases · Rankings · 6 GB · 8 GB · 12 GB · 16 GB · 24 GB · 32 GB · Legal notice (Impressum) · Privacy