LLaVALLaVA

LLaVA 1.5 7B

Legacy
370.2KDownloads552LikesOct 2023Veröffentlicht4K TokenKontextApache 2.0Lizenz44 BasisQualität

LLaVA 1.5 7B (7B parameters) requires approximately 13.9 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 16 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run LLaVA 1.5 7B on your machine.

Run

ollama run llava

Quick specs

Parameters7B
Architecturedense
Context4K tokens
Modalitytext+vision
Min RAM2.7 GB
Rec. RAM4.3 GB (Q4_K_M)
LicenseApache 2.0
FamilyLLaVA
Vision Chat

About this model

Model type: LLaVA is an open-source chatbot trained by fine-tuning LLaMA/Vicuna on GPT-generated multimodal instruction-following data. It is an auto-regressive language model, based on the transformer architecture.

  • 558K filtered image-text pairs from LAION/CC/SBU, captioned by BLIP
  • 158K GPT-generated multimodal instruction-following data
  • 450K academic-task-oriented VQA data mixture
  • 40K ShareGPT data

Verwandte Modelle

Deine Hardware

Erkennung...

Schnellauswahl

Beste Hardware

Top-Empfehlungen für LLaVA 1.5 7B

Dieses Modell ausführen

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
2.7 GB
Low
Q3_K_S
3
3.4 GB
Low
NVFP4
4
3.9 GB
Medium
Q4_K_M
4
4.3 GB
Medium
Q5_K_M
5
5.0 GB
High
Q6_K
6
5.7 GB
High
Q8_0
8
7.5 GB
Very High
F16
16
14.3 GB
Maximum

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights4.3 GB
KV Cache7.8 GB
Runtime1.2 GB
Headroom0.6 GB

Häufig gestellte Fragen

FAQ — LLaVA 1.5 7B

Siehe auch