Mistral
Mixtral 8x7B
現行
889.2Kダウンロード4.7KいいねDec 2023公開日33K トークンコンテキストApache 2.0ライセンス38 基本品質
Mixtral 8x7B (47B parameters) requires approximately 32.4 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 13B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 38 GB of VRAM.
はじめに
— コピー&ペーストでローカル実行Copy-paste commands to run Mixtral 8x7B on your machine.
Run
ollama run mixtralQuick specs
Parameters47B (13B active)
Architecturemoe (MoE)
Context33K tokens
Modalitytext
Min RAM18.3 GB
Rec. RAM28.7 GB (Q4_K_M)
LicenseApache 2.0
FamilyMixtral
✓ Chat✓ Reasoning
About this model
関連モデル
おすすめ
最適なハードウェア
Mixtral 8x7Bのおすすめ
このモデルを実行
量子化オプション
量子化レベル別VRAM推定値
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 18.3 GB | Low | — |
Q3_K_S | 3 | 23.0 GB | Low | — |
NVFP4 | 4 | 26.3 GB | Medium | — |
Q4_K_M | 4 | 28.7 GB | Medium | — |
Q5_K_M | 5 | 33.8 GB | High | — |
Q6_K | 6 | 38.5 GB | High | — |
Q8_0 | 8 | 50.3 GB | Very High | — |
F16 | 16 | 96.4 GB | Maximum | — |
Quality benchmarks
Mixtral 8x7B benchmark scores
Coding
SWE-bench Verified—
HumanEval+64.0%
Aider Polyglot—
LiveCodeBench—
Reasoning
MMLU-Pro54.0%
GPQA Diamond7.0%
MATH-50047.0%
ARC Challenge—
General
Chatbot Arena—
IFEval62.0%
Source: official · 2023-12-11
ハードウェア互換性
全ハードウェアの適合度推定
Computing compatibility...
メモリ内訳
Reference: RTX 2060 6GB
Weights28.7 GB
KV Cache2.0 GB
Runtime1.2 GB
Headroom0.6 GB
よくある質問
FAQ — Mixtral 8x7B
関連項目