DeepSeekDeepSeek

DeepSeek R1 Distill 32B

Frontier
596.8KDownloads1.6KLikesJan 2025Veröffentlicht33K TokenKontextMITLizenz61 GutQualität

DeepSeek R1 Distill 32B (32B parameters) requires approximately 25.2 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 29 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run DeepSeek R1 Distill 32B on your machine.

Run

ollama run deepseek-r1:32b

Quick specs

Parameters32B
Architecturedense
Context33K tokens
Modalitytext
Min RAM12.5 GB
Rec. RAM19.5 GB (Q4_K_M)
LicenseMIT
FamilyDeepSeek
Chat Reasoning

About this model

We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1. DeepSeek-R1-Zero, a model trained via large-scale reinforcement learning (RL) without supervised fine-tuning (SFT) as a preliminary step, demonstrated remarkable performance on reasoning. With RL, DeepSeek-R1-Zero naturally emerged with numerous powerful and interesting reasoning behaviors. However, DeepSeek-R1-Zero encounters challenges such as endless repetition, poor readability, and language mixing.

  • We directly apply reinforcement learning (RL) to the base model without relying on supervised fine-tuning (SFT) as a preliminary step. This...
  • We introduce our pipeline to develop DeepSeek-R1. The pipeline incorporates two RL stages aimed at discovering improved reasoning patterns and...

Verwandte Modelle

Deine Hardware

Erkennung...

Schnellauswahl

Beste Hardware

Top-Empfehlungen für DeepSeek R1 Distill 32B

Dieses Modell ausführen

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
12.5 GB
Low
Q3_K_S
3
15.7 GB
Low
NVFP4
4
17.9 GB
Medium
Q4_K_M
4
19.5 GB
Medium
Q5_K_M
5
23.0 GB
High
Q6_K
6
26.2 GB
High
Q8_0
8
34.2 GB
Very High
F16
16
65.6 GB
Maximum

Quality benchmarks

DeepSeek R1 Distill 32B benchmark scores

Benchmark verified

Coding

SWE-bench Verified
HumanEval+
Aider Polyglot
LiveCodeBench57.2%

Reasoning

MMLU-Pro41.0%
GPQA Diamond62.1%
MATH-50094.3%
ARC Challenge

General

Chatbot Arena
IFEval41.9%

Source: official · 2025-01-20

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights19.5 GB
KV Cache3.9 GB
Runtime1.2 GB
Headroom0.6 GB

Häufig gestellte Fragen

FAQ — DeepSeek R1 Distill 32B

Siehe auch