Will It Run AI

Bartowski

granite embedding 107m multilingual

可用数据有限 — 部分规格可能不完整或为估算值。
0K tokens上下文Unknown许可证4 入门质量

granite embedding 107m multilingual (0.10700000077486038B parameters) requires approximately 2.0 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 3 GB of VRAM.

Quick specs

Parameters0.11B
Architecturedense
Context0K tokens
Modalitytext
Min RAM0 GB
Rec. RAM0.1 GB (Q4_K_M)
LicenseUnknown
FamilyGranite
Chat

相关模型

你的硬件

检测中...

快速推荐

最佳硬件

granite embedding 107m multilingual 的最佳选择

运行此模型

量化选项

各量化级别的 VRAM 估算

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
0.0 GB
Low
Q3_K_S
3
0.1 GB
Low
NVFP4
4
0.1 GB
Medium
Q4_K_M
4
0.1 GB
Medium
Q5_K_M
5
0.1 GB
High
Q6_K
6
0.1 GB
High
Q8_0
8
0.1 GB
Very High
F16
16
0.2 GB
Maximum

硬件兼容性

全部硬件的适配估算

打开计算器

Computing compatibility...

内存详细分析

Reference: RTX 2060 6GB

Weights0.1 GB
KV Cache0.1 GB
Runtime1.2 GB
Headroom0.6 GB

常见问题

FAQ — granite embedding 107m multilingual

另请参阅