Alibaba

Qwen 3 8B

Name: Qwen 3 8B
Rating: 88 (185 reviews)
Author: Alibaba

Frontier

HuggingFace

Ollama

12.8MDownloads1.1KLikesApr 2025Veröffentlicht131K TokenKontextApache 2.0Lizenz93 HerausragendQualität

Qwen 3 8B (8B parameters) requires approximately 8.9 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 11 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run Qwen 3 8B on your machine.

Run

ollama run qwen3:8b

Quick specs

Parameters8B

Architecturedense

Context131K tokens

Modalitytext

Min RAM3.1 GB

Rec. RAM4.9 GB (Q4_K_M)

LicenseApache 2.0

FamilyQwen

✓ Chat✓ Reasoning

About this model

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features:

•Uniquely support of seamless switching between thinking mode: (for complex logical reasoning, math, and coding) and non-thinking mode (for...
•Significantly enhancement in its reasoning capabilities: , surpassing previous QwQ (in thinking mode) and Qwen2.5 instruct models (in non-thinking...
•Superior human preference alignment: , excelling in creative writing, role-playing, multi-turn dialogues, and instruction following, to deliver a...
•Expertise in agent capabilities: , enabling precise integration with external tools in both thinking and unthinking modes and achieving leading...
•Support of 100+ languages and dialects: with strong capabilities for multilingual instruction following and translation

Verwandte Modelle

Schnellauswahl

Bestes BudgetS

Intel Arc B570 10GB~$219 — 45 tok/s

Beste GesamtwahlS

RTX 3080 Ti 12GB~$1,199 — 112 tok/s

Beste Hardware

Top-Empfehlungen für Qwen 3 8B

Dieses Modell ausführen

Qwen 3 8B on RTX 3080 Ti 12GB Qwen 3 8B on RTX 5070 12GB Qwen 3 8B on RTX 3080 12GB

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	3.1 GB	Low	—
Q3_K_S	3	3.9 GB	Low	—
NVFP4	4	4.5 GB	Medium	—
Q4_K_M	4	4.9 GB	Medium	—
Q5_K_M	5	5.8 GB	High	—
Q6_K	6	6.6 GB	High	—
Q8_0	8	8.6 GB	Very High	—
F16	16	16.4 GB	Maximum	—

Quality benchmarks

Qwen 3 8B benchmark scores

Benchmark verified

Reasoning

MMLU-Pro—

GPQA Diamond62.0%

MATH-50097.4%

ARC Challenge—

General

Chatbot Arena—

IFEval85.0%

Source: official · 2025-05-15

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights4.9 GB

KV Cache2.2 GB

Runtime1.2 GB

Headroom0.6 GB

Häufig gestellte Fragen

FAQ — Qwen 3 8B

Siehe auch

Quantisierungsleitfaden Bewertungsmethodik Rechner öffnen