NVIDIANVIDIA

Nemotron Nano 9B v2

Frontier
Jun 2025Veröffentlicht131K TokenKontextNVIDIA Open ModelLizenz70 GutQualität

Nemotron Nano 9B v2 (9B parameters) requires approximately 9.7 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 12 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run Nemotron Nano 9B v2 on your machine.

Run

ollama run nemotron-nano:9b-v2

Quick specs

Parameters9B
Architecturedense
Context131K tokens
Modalitytext
Min RAM3.5 GB
Rec. RAM5.5 GB (Q4_K_M)
LicenseNVIDIA Open Model
FamilyNemotron
Code Chat Reasoning

About this model

Nemotron Nano 9B v2 is an updated version of NVIDIA's compact reasoning model with improved instruction following, coding, and math capabilities.

  • Improved reasoning and coding over v1
  • Switchable thinking mode for detailed step-by-step reasoning
  • Fits comfortably on 8 GB VRAM GPUs at Q4_K_M

Verwandte Modelle

Deine Hardware

Erkennung...

Schnellauswahl

Beste Hardware

Top-Empfehlungen für Nemotron Nano 9B v2

Dieses Modell ausführen

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
3.5 GB
Low
Q3_K_S
3
4.4 GB
Low
NVFP4
4
5.0 GB
Medium
Q4_K_M
4
5.5 GB
Medium
Q5_K_M
5
6.5 GB
High
Q6_K
6
7.4 GB
High
Q8_0
8
9.6 GB
Very High
F16
16
18.5 GB
Maximum

Quality benchmarks

Nemotron Nano 9B v2 benchmark scores

Benchmark verified

Coding

SWE-bench Verified
HumanEval+58.5%
Aider Polyglot
LiveCodeBench

Reasoning

MMLU-Pro59.4%
GPQA Diamond64.0%
MATH-50097.8%
ARC Challenge

Source: official · 2025-09-02

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights5.5 GB
KV Cache2.4 GB
Runtime1.2 GB
Headroom0.6 GB

Häufig gestellte Fragen

FAQ — Nemotron Nano 9B v2

Siehe auch