Google

Gemma 2 2B

Name: Gemma 2 2B
Rating: 50 (196 reviews)
Author: Google

Aktuell

HuggingFace

382.0KDownloads1.4KLikesJun 2024Veröffentlicht8K TokenKontextGemmaLizenz15 EinstiegQualität

Gemma 2 2B (2B parameters) requires approximately 4.6 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 6 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run Gemma 2 2B on your machine.

Run

lms load gemma-2-2b-it && lms server start

Quick specs

Parameters2B

Architecturedense

Context8K tokens

Modalitytext

Min RAM0.8 GB

Rec. RAM1.2 GB (Q4_K_M)

LicenseGemma

FamilyGemma

✓ Chat

About this model

Gemma 2 2B is Google's lightweight model designed for on-device and edge deployment. Delivers strong text generation and reasoning performance at minimal resource cost.

Verwandte Modelle

Schnellauswahl

Bestes BudgetB

Intel Arc A380 6GB~$139 — 28 tok/s

Beste GesamtwahlB

RTX 2060 6GB~$349 — 28 tok/s

Beste Hardware

Top-Empfehlungen für Gemma 2 2B

Intel Arc Pro A40 6GBB

Dieses Modell ausführen

Gemma 2 2B on RTX 4050 Laptop 6GB Gemma 2 2B on RTX 2060 6GB Gemma 2 2B on Intel Arc Pro A40 6GB

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	0.8 GB	Low	—
Q3_K_S	3	1.0 GB	Low	—
NVFP4	4	1.1 GB	Medium	—
Q4_K_M	4	1.2 GB	Medium	—
Q5_K_M	5	1.4 GB	High	—
Q6_K	6	1.6 GB	High	—
Q8_0	8	2.1 GB	Very High	—
F16	16	4.1 GB	Maximum	—

Quality benchmarks

Gemma 2 2B benchmark scores

Benchmark verified

Coding

SWE-bench Verified—

HumanEval+40.2%

Aider Polyglot—

LiveCodeBench—

Reasoning

MMLU-Pro17.2%

GPQA Diamond3.2%

MATH-50036.6%

ARC Challenge68.4%

General

Chatbot Arena—

IFEval56.7%

Source: official · 2024-06-27

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights1.2 GB

KV Cache1.6 GB

Runtime1.2 GB

Headroom0.6 GB

Häufig gestellte Fragen

FAQ — Gemma 2 2B

Siehe auch

Quantisierungsleitfaden Bewertungsmethodik Rechner öffnen