Alibaba
Qwen 3.5 397B A17B
前沿
Jun 2025发布日期131K tokens上下文Apache 2.0许可证100 卓越质量
Qwen 3.5 397B A17B (397B parameters) requires approximately 246.5 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 17B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 284 GB of VRAM.
快速开始
— 复制粘贴即可本地运行Copy-paste commands to run Qwen 3.5 397B A17B on your machine.
Run
docker run --rm -it ghcr.io/ggerganov/llama.cpp:full \
--hf-repo "Qwen/Qwen3.5-397B-A17B-Instruct" \
--hf-file "Qwen3.5-397B-A17B-Instruct-Q4_K_M.gguf" \
-c 4096 -ngl 99Quick specs
Parameters397B (17B active)
Architecturemoe (MoE)
Context131K tokens
Modalitytext
Min RAM154.8 GB
Rec. RAM242.2 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
✓ Code✓ Chat✓ Reasoning
About this model
- •Flagship model — top-tier quality across coding, reasoning, math, and agentic tasks
- •397B total params with 17B active — strong quality with MoE inference efficiency
- •Requires multi-GPU or high-memory setups (150+ GB VRAM at Q4_K_M)
相关模型
快速推荐
最佳硬件
Qwen 3.5 397B A17B 的最佳选择
运行此模型
量化选项
各量化级别的 VRAM 估算
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 154.8 GB | Low | — |
Q3_K_S | 3 | 194.5 GB | Low | — |
NVFP4 | 4 | 222.3 GB | Medium | — |
Q4_K_M | 4 | 242.2 GB | Medium | — |
Q5_K_M | 5 | 285.8 GB | High | — |
Q6_K | 6 | 325.5 GB | High | — |
Q8_0 | 8 | 424.8 GB | Very High | — |
F16 | 16 | 813.8 GB | Maximum | — |
Quality benchmarks
Qwen 3.5 397B A17B benchmark scores
Coding
SWE-bench Verified76.4%
HumanEval+—
Aider Polyglot—
LiveCodeBench83.6%
Reasoning
MMLU-Pro87.8%
GPQA Diamond88.4%
MATH-500—
ARC Challenge—
General
Chatbot Arena—
IFEval92.6%
Source: official · 2025-06-25
硬件兼容性
全部硬件的适配估算
Computing compatibility...
内存详细分析
Reference: RTX 2060 6GB
Weights242.2 GB
KV Cache2.9 GB
Runtime0.9 GB
Headroom0.6 GB
常见问题
FAQ — Qwen 3.5 397B A17B
另请参阅