DeepSeekDeepSeek

DeepSeek R1 Distill 8B

Frontier
476.2KDownloads862LikesJan 2025Veröffentlicht33K TokenKontextMITLizenz41 BasisQualität

DeepSeek R1 Distill 8B (8B parameters) requires approximately 8.6 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 10 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run DeepSeek R1 Distill 8B on your machine.

Run

ollama run deepseek-r1:8b

Quick specs

Parameters8B
Architecturedense
Context33K tokens
Modalitytext
Min RAM3.1 GB
Rec. RAM4.9 GB (Q4_K_M)
LicenseMIT
FamilyDeepSeek
Chat Reasoning

About this model

We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1. DeepSeek-R1-Zero, a model trained via large-scale reinforcement learning (RL) without supervised fine-tuning (SFT) as a preliminary step, demonstrated remarkable performance on reasoning. With RL, DeepSeek-R1-Zero naturally emerged with numerous powerful and interesting reasoning behaviors. However, DeepSeek-R1-Zero encounters challenges such as endless repetition, poor readability, and language mixing.

  • We directly apply reinforcement learning (RL) to the base model without relying on supervised fine-tuning (SFT) as a preliminary step. This...
  • We introduce our pipeline to develop DeepSeek-R1. The pipeline incorporates two RL stages aimed at discovering improved reasoning patterns and...

Verwandte Modelle

Deine Hardware

Erkennung...

Schnellauswahl

Beste Hardware

Top-Empfehlungen für DeepSeek R1 Distill 8B

Dieses Modell ausführen

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
3.1 GB
Low
Q3_K_S
3
3.9 GB
Low
NVFP4
4
4.5 GB
Medium
Q4_K_M
4
4.9 GB
Medium
Q5_K_M
5
5.8 GB
High
Q6_K
6
6.6 GB
High
Q8_0
8
8.6 GB
Very High
F16
16
16.4 GB
Maximum

Quality benchmarks

DeepSeek R1 Distill 8B benchmark scores

Benchmark verified

Coding

SWE-bench Verified
HumanEval+
Aider Polyglot
LiveCodeBench39.6%

Reasoning

MMLU-Pro12.1%
GPQA Diamond49.0%
MATH-50089.1%
ARC Challenge

General

Chatbot Arena
IFEval37.8%

Source: official · 2025-01-20

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights4.9 GB
KV Cache2.0 GB
Runtime1.2 GB
Headroom0.6 GB

Häufig gestellte Fragen

FAQ — DeepSeek R1 Distill 8B

Siehe auch