01.AI
Yi 1.5 34B
Atual
20.4KDownloads278CurtidasMay 2024Publicado4K tokensContextoApache 2.0Licença32 BásicoQualidade
Yi 1.5 34B (34B parameters) requires approximately 26.2 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 31 GB of VRAM.
Comece agora
— copie e cole para rodar localmenteCopy-paste commands to run Yi 1.5 34B on your machine.
Run
lms load Yi-1.5-34B-Chat && lms server startQuick specs
Parameters34B
Architecturedense
Context4K tokens
Modalitytext
Min RAM13.3 GB
Rec. RAM20.7 GB (Q4_K_M)
LicenseApache 2.0
FamilyYi
✓ Chat✓ Reasoning
About this model
Modelos relacionados
Escolhas rápidas
Melhor hardware
Melhores opções para Yi 1.5 34B
Rodar este modelo
Opções de quantização
Estimativas de VRAM por nível de quantização
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 13.3 GB | Low | — |
Q3_K_S | 3 | 16.7 GB | Low | — |
NVFP4 | 4 | 19.0 GB | Medium | — |
Q4_K_M | 4 | 20.7 GB | Medium | — |
Q5_K_M | 5 | 24.5 GB | High | — |
Q6_K | 6 | 27.9 GB | High | — |
Q8_0 | 8 | 36.4 GB | Very High | — |
F16 | 16 | 69.7 GB | Maximum | — |
Quality benchmarks
Yi 1.5 34B benchmark scores
Coding
SWE-bench Verified—
HumanEval+75.2%
Aider Polyglot—
LiveCodeBench—
Reasoning
MMLU-Pro39.1%
GPQA Diamond15.3%
MATH-50027.7%
ARC Challenge—
General
Chatbot Arena—
IFEval60.7%
Source: official · 2024-05-13
Compatibilidade de hardware
Estimativas de compatibilidade para todo o hardware
Computing compatibility...
Detalhamento de memória
Reference: RTX 2060 6GB
Weights20.7 GB
KV Cache3.7 GB
Runtime1.2 GB
Headroom0.6 GB
Perguntas frequentes
FAQ — Yi 1.5 34B
Veja também