Alibaba
Qwen 2.5 14B
Actual
2.1MDescargas342Me gustaSep 2024Publicado131K tokensContextoApache 2.0Licencia73 FuerteCalidad
Qwen 2.5 14B (14B parameters) requires approximately 13.3 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 16 GB of VRAM.
Comenzar
— copia y pega para ejecutar en localCopy-paste commands to run Qwen 2.5 14B on your machine.
Run
ollama run qwen2.5Quick specs
Parameters14B
Architecturedense
Context131K tokens
Modalitytext
Min RAM5.5 GB
Rec. RAM8.5 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
✓ Chat✓ Reasoning
About this model
- •Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models...
- •Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g,...
- •Long-context Support: up to 128K tokens and can generate up to 8K tokens
- •Multilingual support: for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean,...
Modelos relacionados
Selecciones rápidas
Mejor hardware
Mejores opciones para Qwen 2.5 14B
Ejecutar este modelo
Opciones de cuantización
Estimaciones de VRAM por nivel de cuantización
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 5.5 GB | Low | — |
Q3_K_S | 3 | 6.9 GB | Low | — |
NVFP4 | 4 | 7.8 GB | Medium | — |
Q4_K_M | 4 | 8.5 GB | Medium | — |
Q5_K_M | 5 | 10.1 GB | High | — |
Q6_K | 6 | 11.5 GB | High | — |
Q8_0 | 8 | 15.0 GB | Very High | — |
F16 | 16 | 28.7 GB | Maximum | — |
Quality benchmarks
Qwen 2.5 14B benchmark scores
Coding
SWE-bench Verified—
HumanEval+83.5%
Aider Polyglot—
LiveCodeBench42.6%
Reasoning
MMLU-Pro63.7%
GPQA Diamond45.5%
MATH-50080.0%
ARC Challenge—
General
Chatbot Arena—
IFEval81.0%
Source: official · 2024-09-19
Compatibilidad de hardware
Estimaciones de encaje en todo el hardware
Computing compatibility...
Desglose de memoria
Reference: RTX 2060 6GB
Weights8.5 GB
KV Cache2.9 GB
Runtime1.2 GB
Headroom0.6 GB
Preguntas frecuentes
FAQ — Qwen 2.5 14B
Ver también