DeepSeek

DeepSeek LLM 7B

Name: DeepSeek LLM 7B
Rating: 48 (142 reviews)
Author: DeepSeek

レガシー

HuggingFace

Ollama

34.8Kダウンロード222いいねJan 2024公開日4K トークンコンテキストDeepSeekライセンス1 入門品質

DeepSeek LLM 7B (7B parameters) requires approximately 13.4 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 16 GB of VRAM.

はじめに

— コピー&ペーストでローカル実行

Copy-paste commands to run DeepSeek LLM 7B on your machine.

Run

ollama run deepseek-llm

Quick specs

Parameters7B

Architecturedense

Context4K tokens

Modalitytext

Min RAM2.7 GB

Rec. RAM4.3 GB (Q4_K_M)

LicenseDeepSeek

FamilyDeepSeek

✓ Chat

About this model

Introducing DeepSeek LLM, an advanced language model comprising 7 billion parameters. It has been trained from scratch on a vast dataset of 2 trillion tokens in both English and Chinese. In order to foster research, we have made DeepSeek LLM 7B/67B Base and DeepSeek LLM 7B/67B Chat open source for the research community.

•Home Page:: DeepSeek
•Repository:: deepseek-ai/deepseek-LLM
•Chat With DeepSeek LLM:: DeepSeek-LLM

DeepSeek LLM 7Bのおすすめ

このモデルを実行

DeepSeek LLM 7B on RX 7900 XT 20GB DeepSeek LLM 7B on RTX A4500 20GB DeepSeek LLM 7B on RTX 4000 Ada 20GB

量子化オプション

量子化レベル別VRAM推定値

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	2.7 GB	Low	—
Q3_K_S	3	3.4 GB	Low	—
NVFP4	4	3.9 GB	Medium	—
Q4_K_M	4	4.3 GB	Medium	—
Q5_K_M	5	5.0 GB	High	—
Q6_K	6	5.7 GB	High	—
Q8_0	8	7.5 GB	Very High	—
F16	16	14.3 GB	Maximum	—

Quality benchmarks

DeepSeek LLM 7B benchmark scores

Benchmark verified

Reasoning

MMLU-Pro12.6%

GPQA Diamond2.1%

MATH-5002.0%

ARC Challenge—

General

Chatbot Arena—

IFEval41.7%

Source: community · 2025-01-01

ハードウェア互換性

全ハードウェアの適合度推定

カリキュレーターを開く

Computing compatibility...

メモリ内訳

Reference: RTX 2060 6GB

Weights4.3 GB

KV Cache7.3 GB

Runtime1.2 GB

Headroom0.6 GB

よくある質問

DeepSeek LLM 7B

DeepSeek LLM 7Bのおすすめ

量子化レベル別VRAM推定値

DeepSeek LLM 7B benchmark scores

全ハードウェアの適合度推定

Reference: RTX 2060 6GB

FAQ — DeepSeek LLM 7B