Llama 3.2 1B

Name: Llama 3.2 1B
Rating: 46 (196 reviews)
Author: Meta

旧版

8.3M下载量1.4K点赞Sep 2024发布日期128K tokens上下文Community许可证14 入门质量

Llama 3.2 1B (1B parameters) requires approximately 2.9 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 4 GB of VRAM.

快速开始

— 复制粘贴即可本地运行

Copy-paste commands to run Llama 3.2 1B on your machine.

Run

ollama run llama3.2:1b

Quick specs

Parameters1B

Architecturedense

Context128K tokens

Modalitytext

Min RAM0.4 GB

Rec. RAM0.6 GB (Q4_K_M)

LicenseCommunity

FamilyLlama

✓ Chat

About this model

Llama 3.2 1B is Meta's smallest text model designed for on-device inference. Optimized for multilingual text generation, summarization, and instruction following on resource-constrained hardware.

Llama 3.2 1B 的最佳选择

GTX 1650 4GBC

4 GB

RTX 3050 Ti Laptop 4GBC

运行此模型

Llama 3.2 1B on GTX 1650 4GB Llama 3.2 1B on RTX 3050 Ti Laptop 4GB Llama 3.2 1B on Intel Arc A370M 4GB

量化选项

各量化级别的 VRAM 估算

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	0.4 GB	Low	—
Q3_K_S	3	0.5 GB	Low	—
NVFP4	4	0.6 GB	Medium	—
Q4_K_M	4	0.6 GB	Medium	—
Q5_K_M	5	0.7 GB	High	—
Q6_K	6	0.8 GB	High	—
Q8_0	8	1.1 GB	Very High	—
F16	16	2.1 GB	Maximum	—

Quality benchmarks

Llama 3.2 1B benchmark scores

Benchmark verified

Reasoning

MMLU-Pro7.6%

GPQA Diamond27.2%

MATH-50030.6%

ARC Challenge59.4%

General

Chatbot Arena—

IFEval59.5%

Source: official · 2024-09-25

硬件兼容性

全部硬件的适配估算

打开计算器

Computing compatibility...

内存详细分析

Reference: RTX 2060 6GB

Weights0.6 GB

KV Cache0.5 GB

Runtime1.2 GB

Headroom0.6 GB

常见问题

FAQ — Llama 3.2 1B

另请参阅

量化指南评分方法打开计算器