AlibabaAlibaba

Qwen 2.5 Coder 7B

現行
2.3Mダウンロード713いいねSep 2024公開日131K トークンコンテキストApache 2.0ライセンス48 基本品質

Qwen 2.5 Coder 7B (7B parameters) requires approximately 6.6 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 8 GB of VRAM.

はじめに

— コピー&ペーストでローカル実行

Copy-paste commands to run Qwen 2.5 Coder 7B on your machine.

Run

ollama run qwen2.5-coder:7b

Quick specs

Parameters7B
Architecturedense
Context131K tokens
Modalitytext
Min RAM2.7 GB
Rec. RAM4.3 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
Code

About this model

Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5-Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5-Coder brings the following improvements upon CodeQwen1.5:

  • Significantly improvements in code generation, code reasoning and code fixing. Base on the strong Qwen2.5, we scale up the training...
  • A more comprehensive foundation for real-world applications such as Code Agents. Not only enhancing coding capabilities but also maintaining...
  • Long-context Support: up to 128K tokens

関連モデル

あなたのハードウェア

検出中...

おすすめ

最適なハードウェア

Qwen 2.5 Coder 7Bのおすすめ

このモデルを実行

量子化オプション

量子化レベル別VRAM推定値

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
2.7 GB
Low
Q3_K_S
3
3.4 GB
Low
NVFP4
4
3.9 GB
Medium
Q4_K_M
4
4.3 GB
Medium
Q5_K_M
5
5.0 GB
High
Q6_K
6
5.7 GB
High
Q8_0
8
7.5 GB
Very High
F16
16
14.3 GB
Maximum

Quality benchmarks

Qwen 2.5 Coder 7B benchmark scores

Benchmark verified

Coding

SWE-bench Verified22.0%
HumanEval+84.1%
Aider Polyglot
LiveCodeBench37.6%

Reasoning

MMLU-Pro45.6%
GPQA Diamond35.6%
MATH-50066.8%
ARC Challenge

General

Chatbot Arena
IFEval58.6%

Source: official · 2024-11-12

ハードウェア互換性

全ハードウェアの適合度推定

カリキュレーターを開く

Computing compatibility...

メモリ内訳

Reference: RTX 2060 6GB

Weights4.3 GB
KV Cache0.9 GB
Runtime0.9 GB
Headroom0.6 GB

よくある質問

FAQ — Qwen 2.5 Coder 7B

関連項目