IBM
Granite 4.1 30B
Actual
32.1KDescargas126Me gustaApr 2026Publicado131K tokensContextoApache 2.0Licencia76 FuerteCalidad
Granite 4.1 30B (30B parameters) requires approximately 24.0 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 28 GB of VRAM.
Comenzar
— copia y pega para ejecutar en localCopy-paste commands to run Granite 4.1 30B on your machine.
Run
ollama run granite4.1:30bQuick specs
Parameters30B
Architecturedense
Context131K tokens
Modalitytext
Min RAM11.7 GB
Rec. RAM18.3 GB (Q4_K_M)
LicenseApache 2.0
FamilyGranite
✓ Code✓ Chat✓ Reasoning✓ RAG
About this model
- •Dense 30B runs on 24 GB GPUs (RTX 4090/3090) at Q4
- •Apache 2.0 license for commercial RAG, coding, and assistant use
- •128K context for long-document and agent workflows
Modelos relacionados
Selecciones rápidas
Mejor hardware
Mejores opciones para Granite 4.1 30B
Ejecutar este modelo
Opciones de cuantización
Estimaciones de VRAM por nivel de cuantización
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 11.7 GB | Low | — |
Q3_K_S | 3 | 14.7 GB | Low | — |
NVFP4 | 4 | 16.8 GB | Medium | — |
Q4_K_M | 4 | 18.3 GB | Medium | — |
Q5_K_M | 5 | 21.6 GB | High | — |
Q6_K | 6 | 24.6 GB | High | — |
Q8_0 | 8 | 32.1 GB | Very High | — |
F16 | 16 | 61.5 GB | Maximum | — |
Compatibilidad de hardware
Estimaciones de encaje en todo el hardware
Computing compatibility...
Desglose de memoria
Reference: RTX 2060 6GB
Weights18.3 GB
KV Cache3.9 GB
Runtime1.2 GB
Headroom0.6 GB
Preguntas frecuentes
FAQ — Granite 4.1 30B
Ver también