Mistral
Leanstral 119B A6B
Actual
99Descargas157Me gustaMar 2026Publicado256K tokensContextoApache 2.0Licencia84 FuerteCalidad
Leanstral 119B A6B (119B parameters) requires approximately 84.4 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 6.5B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 98 GB of VRAM.
Comenzar
— copia y pega para ejecutar en localCopy-paste commands to run Leanstral 119B A6B on your machine.
Run
docker run --rm -it ghcr.io/ggerganov/llama.cpp:full \
--hf-repo "mistralai/Leanstral-2603" \
--hf-file "Leanstral-2603-Q4_K_M.gguf" \
-c 4096 -ngl 99Quick specs
Parameters119B (6.5B active)
Architecturemoe (MoE)
Context256K tokens
Modalitytext+vision
Min RAM46.4 GB
Rec. RAM72.6 GB (Q4_K_M)
LicenseApache 2.0
FamilyMistral Small
✓ Vision✓ Code✓ Reasoning
About this model
- •119B total params with 6.5B active per token
- •Specialized for proof engineering and code-agent workflows
- •256K context with multimodal text and image input
Modelos relacionados
Selecciones rápidas
Mejor hardware
Mejores opciones para Leanstral 119B A6B
Ejecutar este modelo
Opciones de cuantización
Estimaciones de VRAM por nivel de cuantización
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 46.4 GB | Low | — |
Q3_K_S | 3 | 58.3 GB | Low | — |
NVFP4 | 4 | 66.6 GB | Medium | — |
Q4_K_M | 4 | 72.6 GB | Medium | — |
Q5_K_M | 5 | 85.7 GB | High | — |
Q6_K | 6 | 97.6 GB | High | — |
Q8_0 | 8 | 127.3 GB | Very High | — |
F16 | 16 | 244.0 GB | Maximum | — |
Compatibilidad de hardware
Estimaciones de encaje en todo el hardware
Computing compatibility...
Desglose de memoria
Reference: RTX 2060 6GB
Weights72.6 GB
KV Cache8.8 GB
Runtime2.4 GB
Headroom0.6 GB
Preguntas frecuentes
FAQ — Leanstral 119B A6B
Ver también