AlibabaAlibaba

Qwen 2.5 14B

現行
2.1Mダウンロード342いいねSep 2024公開日131K トークンコンテキストApache 2.0ライセンス73 優秀品質

Qwen 2.5 14B (14B parameters) requires approximately 13.3 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 16 GB of VRAM.

はじめに

— コピー&ペーストでローカル実行

Copy-paste commands to run Qwen 2.5 14B on your machine.

Run

ollama run qwen2.5

Quick specs

Parameters14B
Architecturedense
Context131K tokens
Modalitytext
Min RAM5.5 GB
Rec. RAM8.5 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
Chat Reasoning

About this model

Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

  • Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models...
  • Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g,...
  • Long-context Support: up to 128K tokens and can generate up to 8K tokens
  • Multilingual support: for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean,...

関連モデル

あなたのハードウェア

検出中...

おすすめ

最適なハードウェア

Qwen 2.5 14Bのおすすめ

このモデルを実行

量子化オプション

量子化レベル別VRAM推定値

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
5.5 GB
Low
Q3_K_S
3
6.9 GB
Low
NVFP4
4
7.8 GB
Medium
Q4_K_M
4
8.5 GB
Medium
Q5_K_M
5
10.1 GB
High
Q6_K
6
11.5 GB
High
Q8_0
8
15.0 GB
Very High
F16
16
28.7 GB
Maximum

Quality benchmarks

Qwen 2.5 14B benchmark scores

Benchmark verified

Coding

SWE-bench Verified
HumanEval+83.5%
Aider Polyglot
LiveCodeBench42.6%

Reasoning

MMLU-Pro63.7%
GPQA Diamond45.5%
MATH-50080.0%
ARC Challenge

General

Chatbot Arena
IFEval81.0%

Source: official · 2024-09-19

ハードウェア互換性

全ハードウェアの適合度推定

カリキュレーターを開く

Computing compatibility...

メモリ内訳

Reference: RTX 2060 6GB

Weights8.5 GB
KV Cache2.9 GB
Runtime1.2 GB
Headroom0.6 GB

よくある質問

FAQ — Qwen 2.5 14B

関連項目