Mistral
Mixtral 8x7B
Atual
889.2KDownloads4.7KCurtidasDec 2023Publicado33K tokensContextoApache 2.0Licença38 BásicoQualidade
Mixtral 8x7B (47B parameters) requires approximately 32.4 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 13B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 38 GB of VRAM.
Comece agora
— copie e cole para rodar localmenteCopy-paste commands to run Mixtral 8x7B on your machine.
Run
ollama run mixtralQuick specs
Parameters47B (13B active)
Architecturemoe (MoE)
Context33K tokens
Modalitytext
Min RAM18.3 GB
Rec. RAM28.7 GB (Q4_K_M)
LicenseApache 2.0
FamilyMixtral
✓ Chat✓ Reasoning
About this model
Modelos relacionados
Escolhas rápidas
Melhor hardware
Melhores opções para Mixtral 8x7B
Rodar este modelo
Opções de quantização
Estimativas de VRAM por nível de quantização
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 18.3 GB | Low | — |
Q3_K_S | 3 | 23.0 GB | Low | — |
NVFP4 | 4 | 26.3 GB | Medium | — |
Q4_K_M | 4 | 28.7 GB | Medium | — |
Q5_K_M | 5 | 33.8 GB | High | — |
Q6_K | 6 | 38.5 GB | High | — |
Q8_0 | 8 | 50.3 GB | Very High | — |
F16 | 16 | 96.4 GB | Maximum | — |
Quality benchmarks
Mixtral 8x7B benchmark scores
Coding
SWE-bench Verified—
HumanEval+64.0%
Aider Polyglot—
LiveCodeBench—
Reasoning
MMLU-Pro54.0%
GPQA Diamond7.0%
MATH-50047.0%
ARC Challenge—
General
Chatbot Arena—
IFEval62.0%
Source: official · 2023-12-11
Compatibilidade de hardware
Estimativas de compatibilidade para todo o hardware
Computing compatibility...
Detalhamento de memória
Reference: RTX 2060 6GB
Weights28.7 GB
KV Cache2.0 GB
Runtime1.2 GB
Headroom0.6 GB
Perguntas frequentes
FAQ — Mixtral 8x7B
Veja também