Cohere

Command R+ 104B

Name: Command R+ 104B
Rating: 66 (34 reviews)
Author: Cohere

現行

HuggingFace

Ollama

1.8Kダウンロード285いいねApr 2024公開日131K トークンコンテキストCC-BY-NC-4.0ライセンス43 基本品質

Command R+ 104B (104B parameters) requires approximately 68.4 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 79 GB of VRAM.

はじめに

— コピー&ペーストでローカル実行

Copy-paste commands to run Command R+ 104B on your machine.

Run

ollama run command-r-plus

Quick specs

Parameters104B

Architecturedense

Context131K tokens

Modalitytext

Min RAM40.6 GB

Rec. RAM63.4 GB (Q4_K_M)

LicenseCC-BY-NC-4.0

FamilyCommand

✓ Chat✓ Reasoning✓ RAG

About this model

Command R+ is Cohere's most capable open-weight model for enterprise RAG workloads. Offers superior long-context reasoning, multi-step tool use, and grounded generation with citations across 10 languages.

Command R+ 104Bのおすすめ

AMD Instinct MI300A 128GBA

128 GB

NVIDIA H200 141GBA

141 GB

NVIDIA H200 PCIe 141GBA

141 GB

このモデルを実行

Command R+ 104B on NVIDIA GH200 96GB Command R+ 104B on NVIDIA H20 96GB Command R+ 104B on AMD Instinct MI300A 128GB

量子化オプション

量子化レベル別VRAM推定値

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	40.6 GB	Low	—
Q3_K_S	3	51.0 GB	Low	—
NVFP4	4	58.2 GB	Medium	—
Q4_K_M	4	63.4 GB	Medium	—
Q5_K_M	5	74.9 GB	High	—
Q6_K	6	85.3 GB	High	—
Q8_0	8	111.3 GB	Very High	—
F16	16	213.2 GB	Maximum	—

Quality benchmarks

Command R+ 104B benchmark scores

Benchmark verified

Coding

SWE-bench Verified—

HumanEval+74.4%

Aider Polyglot—

LiveCodeBench—

Reasoning

MMLU-Pro54.7%

GPQA Diamond13.4%

MATH-50046.0%

ARC Challenge—

General

Chatbot Arena—

IFEval60.0%

Source: official · 2024-04-04

ハードウェア互換性

全ハードウェアの適合度推定

カリキュレーターを開く

Computing compatibility...

メモリ内訳

Reference: RTX 2060 6GB

Weights63.4 GB

KV Cache3.4 GB

Runtime0.9 GB

Headroom0.6 GB

よくある質問