Will It Run AI

Jina AIJina AI

Jina Embeddings v3

当前
4.0M下载量1.1K点赞Sep 2024发布日期8K tokens上下文CC-BY-NC-4.0许可证86 优秀质量

Jina Embeddings v3 (0.5720000267028809B parameters) requires approximately 4.9 GB of VRAM with F16 quantization. For the best balance of quality and speed, we recommend hardware with at least 6 GB of VRAM.

快速开始

— 复制粘贴即可本地运行

Copy-paste commands to run Jina Embeddings v3 on your machine.

Run

ollama run jina/jina-embeddings-v3

Quick specs

Parameters0.57B
Architecturedense
Context8K tokens
Modalityembedding
Min RAM0.2 GB
Rec. RAM1.2 GB (F16)
LicenseCC-BY-NC-4.0
FamilyJina Embeddings
RAG

About this model

jina-embeddings-v3: Multilingual Embeddings With Task LoRA

  • Extended Sequence Length:: Supports up to 8192 tokens with RoPE
  • Task-Specific Embedding:: Customize embeddings through the task argument with the following options:
  • retrieval.query: Used for query embeddings in asymmetric retrieval tasks
  • retrieval.passage: Used for passage embeddings in asymmetric retrieval tasks
  • separation: Used for embeddings in clustering and re-ranking applications

你的硬件

检测中...

快速推荐

最佳硬件

Jina Embeddings v3 的最佳选择

运行此模型

量化选项

各量化级别的 VRAM 估算

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
0.2 GB
Low
Q3_K_S
3
0.3 GB
Low
NVFP4
4
0.3 GB
Medium
Q4_K_M
4
0.3 GB
Medium
Q5_K_M
5
0.4 GB
High
Q6_K
6
0.5 GB
High
Q8_0
8
0.6 GB
Very High
F16
16
1.2 GB
Maximum

硬件兼容性

全部硬件的适配估算

打开计算器

Computing compatibility...

内存详细分析

Reference: RTX 2060 6GB

Weights1.2 GB
KV Cache2.0 GB
Runtime1.2 GB
Headroom0.6 GB

常见问题

FAQ — Jina Embeddings v3

另请参阅