Will It Run AI

AlibabaAlibaba

Qwen 2.5 Coder 14B

当前
2.1M下载量157点赞Nov 2024发布日期131K tokens上下文Apache 2.0许可证36 基础质量

Qwen 2.5 Coder 14B (14B parameters) requires approximately 13.3 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 16 GB of VRAM.

快速开始

— 复制粘贴即可本地运行

Copy-paste commands to run Qwen 2.5 Coder 14B on your machine.

Run

ollama run qwen2.5-coder:14b

Quick specs

Parameters14B
Architecturedense
Context131K tokens
Modalitytext
Min RAM5.5 GB
Rec. RAM8.5 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
Code

About this model

Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5-Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5-Coder brings the following improvements upon CodeQwen1.5:

  • Significantly improvements in code generation, code reasoning and code fixing. Base on the strong Qwen2.5, we scale up the training...
  • A more comprehensive foundation for real-world applications such as Code Agents. Not only enhancing coding capabilities but also maintaining...
  • Long-context Support: up to 128K tokens

相关模型

你的硬件

检测中...

快速推荐

最佳硬件

Qwen 2.5 Coder 14B 的最佳选择

运行此模型

量化选项

各量化级别的 VRAM 估算

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
5.5 GB
Low
Q3_K_S
3
6.9 GB
Low
NVFP4
4
7.8 GB
Medium
Q4_K_M
4
8.5 GB
Medium
Q5_K_M
5
10.1 GB
High
Q6_K
6
11.5 GB
High
Q8_0
8
15.0 GB
Very High
F16
16
28.7 GB
Maximum

Quality benchmarks

Qwen 2.5 Coder 14B benchmark scores

Benchmark verified

Coding

SWE-bench Verified27.0%
HumanEval+83.5%
Aider Polyglot
LiveCodeBench31.5%

Reasoning

MMLU-Pro32.7%
GPQA Diamond7.3%
MATH-50032.5%
ARC Challenge

General

Chatbot Arena
IFEval69.1%

Source: official · 2024-11-12

硬件兼容性

全部硬件的适配估算

打开计算器

Computing compatibility...

内存详细分析

Reference: RTX 2060 6GB

Weights8.5 GB
KV Cache2.9 GB
Runtime1.2 GB
Headroom0.6 GB

常见问题

FAQ — Qwen 2.5 Coder 14B

另请参阅