IBM

Granite 4.1 3B

現行

HuggingFace

Ollama

77.4Kダウンロード73いいねApr 2026公開日131K トークンコンテキストApache 2.0ライセンス42 基本品質

Granite 4.1 3B (3B parameters) requires approximately 4.9 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 6 GB of VRAM.

はじめに

— コピー&ペーストでローカル実行

Copy-paste commands to run Granite 4.1 3B on your machine.

Run

ollama run granite4.1:3b

Quick specs

Parameters3B

Architecturedense

Context131K tokens

Modalitytext

Min RAM1.2 GB

Rec. RAM1.8 GB (Q4_K_M)

LicenseApache 2.0

FamilyGranite

✓ Code✓ Chat✓ RAG

About this model

Granite 4.1 3B is IBM's smallest Granite 4.1 dense decoder-only model, trained on roughly 15T tokens with 128K context. Apache 2.0 licensed and tuned for fast, commercially-friendly RAG, coding, and assistant workloads on small GPUs.

•Dense decoder-only 3B — runs on 8 GB GPUs at Q8 or BF16
•Apache 2.0 license for commercial RAG and assistant use
•128K context for long-document retrieval

Granite 4.1 3Bのおすすめ

Intel Arc Pro A40 6GBA

このモデルを実行

Granite 4.1 3B on RTX 4050 Laptop 6GB Granite 4.1 3B on RTX 2060 6GB Granite 4.1 3B on Intel Arc Pro A40 6GB

量子化オプション

量子化レベル別VRAM推定値

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	1.2 GB	Low	—
Q3_K_S	3	1.5 GB	Low	—
NVFP4	4	1.7 GB	Medium	—
Q4_K_M	4	1.8 GB	Medium	—
Q5_K_M	5	2.2 GB	High	—
Q6_K	6	2.5 GB	High	—
Q8_0	8	3.2 GB	Very High	—
F16	16	6.1 GB	Maximum	—

ハードウェア互換性

全ハードウェアの適合度推定

カリキュレーターを開く

Computing compatibility...

メモリ内訳

Reference: RTX 2060 6GB

Weights1.8 GB

KV Cache1.2 GB

Runtime1.2 GB

Headroom0.6 GB

よくある質問

Granite 4.1 3B

Granite 4.1 3Bのおすすめ

量子化レベル別VRAM推定値

全ハードウェアの適合度推定

Reference: RTX 2060 6GB

FAQ — Granite 4.1 3B