Z.ai
GLM-5.1
前沿141.5K下载量1.7K点赞Apr 2026发布日期200K tokens上下文MIT许可证92 卓越质量
GLM-5.1 (754B parameters) requires approximately 482.0 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 40B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 555 GB of VRAM.
快速开始
— 复制粘贴即可本地运行Copy-paste commands to run GLM-5.1 on your machine.
Run
docker run --rm -it ghcr.io/ggerganov/llama.cpp:full \
--hf-repo "zai-org/GLM-5.1" \
--hf-file "GLM-5.1-Q4_K_M.gguf" \
-c 4096 -ngl 99Quick specs
Parameters754B (40B active)
Architecturemoe (MoE)
Context200K tokens
Modalitytext
Min RAM294.1 GB
Rec. RAM459.9 GB (Q4_K_M)
LicenseMIT
FamilyGLM
✓ Code✓ Chat✓ Reasoning
About this model
- •Agentic engineering focus: leads GLM-5 by a wide margin on NL2Repo (repo generation) and Terminal-Bench 2.0 (real-world terminal tasks).
- •State-of-the-art SWE-Bench Pro performance (58.4), surpassing GLM-5, Claude Opus 4.6, and GPT-5.4.
- •Built to stay effective over much longer horizons — breaks complex problems down, runs experiments, reads results, and revises strategy through repeated iteration.
- •Uses DeepSeek Sparse Attention (DSA) MoE architecture (256 routed experts, 8 active per token, 1 shared) for reduced deployment cost.
相关模型
量化选项
各量化级别的 VRAM 估算
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 294.1 GB | Low | — |
Q3_K_S | 3 | 369.5 GB | Low | — |
NVFP4 | 4 | 422.2 GB | Medium | — |
Q4_K_M | 4 | 459.9 GB | Medium | — |
Q5_K_M | 5 | 542.9 GB | High | — |
Q6_K | 6 | 618.3 GB | High | — |
Q8_0 | 8 | 806.8 GB | Very High | — |
F16 | 16 | 1545.7 GB | Maximum | — |
Quality benchmarks
GLM-5.1 benchmark scores
Reasoning
MMLU-Pro—
GPQA Diamond86.2%
MATH-500—
ARC Challenge—
Source: official · 2026-04-03
硬件兼容性
全部硬件的适配估算
Computing compatibility...
内存详细分析
Reference: RTX 2060 6GB
Weights459.9 GB
KV Cache19.0 GB
Runtime2.4 GB
Headroom0.6 GB
常见问题
FAQ — GLM-5.1
另请参阅