Olmo 3 7B Instruct SFT

Ai2 · released 2025-12-01 · Apache-2.0 license

Ai2's Olmo 3 7B Instruct SFT is the supervised-finetuned checkpoint of a fully-open 7B: vendor IFEval 81.7, GPQA 30.0, LiveCodeBench v3 20.0, AIME 6.7. Later DPO/RLVR variants score notably higher.

Key specs

TypeLocal open-weight
Parameters7.3B total
Architectureolmo3
Context window66K tokens
Knowledge cutoff2024-12-01
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond30%
SWE-bench Verified
AIME6.7%
MMLU-Pro
BFCL v3 (tool use)48.9%
Composite score3.76
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M5.7 GB4.2 GB66K

Strengths & weaknesses

Strengths: Fully open (weights + data + training code); Decent instruction following (IFEval 81.7) and strong safety; Apache-2.0

Weaknesses: Weak coding (LiveCodeBench v3 20.0) and math (AIME 6.7); This is the SFT-only checkpoint; DPO/RLVR variants score higher