Will It Run AI

NVIDIANVIDIA

Nemotron Cascade 2 30B A3B

Frontier
huggingfaceHuggingFaceollamaOllama
Mar 2026Veröffentlicht262K TokenKontextNVIDIA Open Model LicenseLizenz88 StarkQualität

Nemotron Cascade 2 30B A3B (30B parameters) requires approximately 23.0 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 3B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 27 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run Nemotron Cascade 2 30B A3B on your machine.

Run

ollama run nemotron-cascade-2

Quick specs

Parameters30B (3B active)
Architecturemoe (MoE)
Context262K tokens
Modalitytext
Min RAM11.7 GB
Rec. RAM18.3 GB (Q4_K_M)
LicenseNVIDIA Open Model License
FamilyNemotron
✓ Code✓ Chat✓ Reasoning

About this model

NVIDIA Nemotron Cascade 2 is a 30B MoE model with 3B active parameters, using a Mamba-2 + Transformer hybrid architecture. Gold medal at IMO 2025 and IOI 2025. 92% AIME 2025, 87% LiveCodeBench. Fits on a single RTX 4090.

  • •MoE: 30B total / 3B active — runs on single RTX 4090
  • •Mamba-2 + Transformer hybrid architecture
  • •Gold medal IMO 2025, IOI 2025, ICPC 2025
  • •92.4% AIME 2025, 87.2% LiveCodeBench v6
  • •262K context window
  • •Thinking + instruct dual mode

Verwandte Modelle

Deine Hardware

Erkennung...

Schnellauswahl

Bestes BudgetS
Mac mini M4 64GB~$1,099 — 13 tok/s
NVIDIA
Beste GesamtwahlS
RTX 5090 32GB~$1,999 — 186 tok/s

Beste Hardware

Top-Empfehlungen für Nemotron Cascade 2 30B A3B

NVIDIA
RTX 5090 32GBS
32 GB
NVIDIA
RTX PRO 4500 Blackwell 32GBS
32 GB
NVIDIA
NVIDIA V100 32GBS
32 GB
AMD Instinct MI100 32GBS
32 GB
AMD Instinct MI60 32GBS
32 GB

Dieses Modell ausführen

Nemotron Cascade 2 30B A3B on RTX 5090 32GBNemotron Cascade 2 30B A3B on RTX PRO 4500 Blackwell 32GBNemotron Cascade 2 30B A3B on NVIDIA V100 32GB

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
11.7 GB
Low—
Q3_K_S
3
14.7 GB
Low—
NVFP4
4
16.8 GB
Medium—
Q4_K_M
4
18.3 GB
Medium—
Q5_K_M
5
21.6 GB
High—
Q6_K
6
24.6 GB
High—
Q8_0
8
32.1 GB
Very High—
F16
16
61.5 GB
Maximum—

Quality benchmarks

Nemotron Cascade 2 30B A3B benchmark scores

Benchmark verified

Coding

SWE-bench Verified—
HumanEval+—
Aider Polyglot—
LiveCodeBench87.2%

Reasoning

MMLU-Pro79.8%
GPQA Diamond76.1%
MATH-500—
ARC Challenge—

Source: official · 2026-03-19

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights18.3 GB
KV Cache2.9 GB
Runtime1.2 GB
Headroom0.6 GB

Häufig gestellte Fragen

FAQ — Nemotron Cascade 2 30B A3B

Siehe auch

QuantisierungsleitfadenBewertungsmethodikRechner öffnen