Gemma 2 9B Instruct
Google · released 2024-06-01 · Gemma license
Gemma 2 9B Instruct is Google's mid-2024 open model, a leading sub-10B chat model at release. Third-party evals put MMLU-Pro near 50 and IFEval at 73.2; its 8K context is a limitation.
Key specs
| Type | Local open-weight |
|---|---|
| Parameters | — |
| Architecture | — |
| Context window | — |
| Knowledge cutoff | — |
| Modalities | text |
| Recommended backends | — |
| Minimum viable rig | — |
Benchmark scores
| GPQA Diamond | — |
|---|---|
| SWE-bench Verified | — |
| AIME | — |
| MMLU-Pro | 50.1% |
| BFCL v3 (tool use) | — |
| Composite score | 6.06 |
| Community rating | No reviews yet |
Strengths & weaknesses
Strengths: A leading sub-10B chat model at release (high LMArena Elo); Strong general knowledge and instruction-following
Weaknesses: Short 8K context limits long-document tasks; Modest math/coding vs later small models