Alibaba
Qwen 2.5 32B
Atual
939.4KDownloads351CurtidasSep 2024Publicado131K tokensContextoApache 2.0Licença79 ForteQualidade
Qwen 2.5 32B (32B parameters) requires approximately 25.2 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 29 GB of VRAM.
Comece agora
— copie e cole para rodar localmenteCopy-paste commands to run Qwen 2.5 32B on your machine.
Run
ollama run qwen2.5Quick specs
Parameters32B
Architecturedense
Context131K tokens
Modalitytext
Min RAM12.5 GB
Rec. RAM19.5 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
✓ Code✓ Chat✓ Reasoning
About this model
- •Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models...
- •Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g,...
- •Long-context Support: up to 128K tokens and can generate up to 8K tokens
- •Multilingual support: for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean,...
Modelos relacionados
Escolhas rápidas
Melhor hardware
Melhores opções para Qwen 2.5 32B
Rodar este modelo
Opções de quantização
Estimativas de VRAM por nível de quantização
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 12.5 GB | Low | — |
Q3_K_S | 3 | 15.7 GB | Low | — |
NVFP4 | 4 | 17.9 GB | Medium | — |
Q4_K_M | 4 | 19.5 GB | Medium | — |
Q5_K_M | 5 | 23.0 GB | High | — |
Q6_K | 6 | 26.2 GB | High | — |
Q8_0 | 8 | 34.2 GB | Very High | — |
F16 | 16 | 65.6 GB | Maximum | — |
Quality benchmarks
Qwen 2.5 32B benchmark scores
Coding
SWE-bench Verified—
HumanEval+88.4%
Aider Polyglot—
LiveCodeBench51.2%
Reasoning
MMLU-Pro69.0%
GPQA Diamond49.5%
MATH-50083.1%
ARC Challenge—
General
Chatbot Arena—
IFEval79.5%
Source: official · 2024-09-19
Compatibilidade de hardware
Estimativas de compatibilidade para todo o hardware
Computing compatibility...
Detalhamento de memória
Reference: RTX 2060 6GB
Weights19.5 GB
KV Cache3.9 GB
Runtime1.2 GB
Headroom0.6 GB
Perguntas frequentes
FAQ — Qwen 2.5 32B
Veja também