Alibaba
Qwen 2.5 14B
Atual
2.1MDownloads342CurtidasSep 2024Publicado131K tokensContextoApache 2.0Licença73 ForteQualidade
Qwen 2.5 14B (14B parameters) requires approximately 13.3 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 16 GB of VRAM.
Comece agora
— copie e cole para rodar localmenteCopy-paste commands to run Qwen 2.5 14B on your machine.
Run
ollama run qwen2.5Quick specs
Parameters14B
Architecturedense
Context131K tokens
Modalitytext
Min RAM5.5 GB
Rec. RAM8.5 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
✓ Chat✓ Reasoning
About this model
- •Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models...
- •Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g,...
- •Long-context Support: up to 128K tokens and can generate up to 8K tokens
- •Multilingual support: for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean,...
Modelos relacionados
Escolhas rápidas
Melhor hardware
Melhores opções para Qwen 2.5 14B
Rodar este modelo
Opções de quantização
Estimativas de VRAM por nível de quantização
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 5.5 GB | Low | — |
Q3_K_S | 3 | 6.9 GB | Low | — |
NVFP4 | 4 | 7.8 GB | Medium | — |
Q4_K_M | 4 | 8.5 GB | Medium | — |
Q5_K_M | 5 | 10.1 GB | High | — |
Q6_K | 6 | 11.5 GB | High | — |
Q8_0 | 8 | 15.0 GB | Very High | — |
F16 | 16 | 28.7 GB | Maximum | — |
Quality benchmarks
Qwen 2.5 14B benchmark scores
Coding
SWE-bench Verified—
HumanEval+83.5%
Aider Polyglot—
LiveCodeBench42.6%
Reasoning
MMLU-Pro63.7%
GPQA Diamond45.5%
MATH-50080.0%
ARC Challenge—
General
Chatbot Arena—
IFEval81.0%
Source: official · 2024-09-19
Compatibilidade de hardware
Estimativas de compatibilidade para todo o hardware
Computing compatibility...
Detalhamento de memória
Reference: RTX 2060 6GB
Weights8.5 GB
KV Cache2.9 GB
Runtime1.2 GB
Headroom0.6 GB
Perguntas frequentes
FAQ — Qwen 2.5 14B
Veja também