Will It Run AI

TheBloke

TinyLlama 1.1B Chat v1.0

可用数据有限 — 部分规格可能不完整或为估算值。
0K tokens上下文Unknown许可证5 入门质量

TinyLlama 1.1B Chat v1.0 (1.100000023841858B parameters) requires approximately 2.6 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 3 GB of VRAM.

Quick specs

Parameters1.1B
Architecturedense
Context0K tokens
Modalitytext
Min RAM0.4 GB
Rec. RAM0.7 GB (Q4_K_M)
LicenseUnknown
FamilyLlama
Chat

相关模型

你的硬件

检测中...

快速推荐

最佳硬件

TinyLlama 1.1B Chat v1.0 的最佳选择

运行此模型

量化选项

各量化级别的 VRAM 估算

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
0.4 GB
Low
Q3_K_S
3
0.5 GB
Low
NVFP4
4
0.6 GB
Medium
Q4_K_M
4
0.7 GB
Medium
Q5_K_M
5
0.8 GB
High
Q6_K
6
0.9 GB
High
Q8_0
8
1.2 GB
Very High
F16
16
2.3 GB
Maximum

硬件兼容性

全部硬件的适配估算

打开计算器

Computing compatibility...

内存详细分析

Reference: RTX 2060 6GB

Weights0.7 GB
KV Cache0.1 GB
Runtime1.2 GB
Headroom0.6 GB

常见问题

FAQ — TinyLlama 1.1B Chat v1.0

另请参阅