Hermes 3 Llama 3.1 70B

NousResearch · released 2024-08-18 · llama3 license

Hermes 3 Llama 3.1 70B by NousResearch — 70.55B open-weight local LLM. License: llama3. Benchmarks, VRAM requirements per quantization, GPU compatibility, pricing and community reviews on robotanalyze.com.

Key specs

TypeLocal open-weight
Parameters70.55B total
Architecturellama
Context window131K tokens
Knowledge cutoff2023-12-31
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond
SWE-bench Verified
AIME
MMLU-Pro
BFCL v3 (tool use)
Composite score
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M42.4 GB40.9 GB131K