Will It Run AI

NVIDIA

RTX PRO 6000 Blackwell Workstation Edition 96GB

RTX PRO BlackwellWorkstationBlackwellPCIe 5CUDA
96GB
VRAM
1.8kGB/s
Bandwidth
125TFLOPS
FP16 Compute
4kTOPS
INT8 Inference
$9,999 MSRP
VRAM96 GBBandwidth1.8k GB/sCompute125 TFInference4k TOPSValue1.25 TF/$k
RTX PRO 6000 Blackwell Workstation Edition 96GBCategory AvgNVIDIA H200 141GB

Operating mode

Choose the operating mode for this hardware

Use this to bias workload recommendations toward responsiveness, background autonomy, lighter serving, or multi-GPU scale-out.

Current mode

Balanced

Balanced for general local use. Keeps the ranking neutral across personal and serving workflows.

About this GPU for AI

La RTX PRO 6000 Blackwell Workstation Edition es la GPU de estación de trabajo individual más potente jamás construida, con 96 GB de GDDR7 ECC a 1.792 GB/s de ancho de banda con 125 TFLOPS FP16 y 4.000 TOPS INT8. Basada en el die GB202 con 24.064 núcleos CUDA, puede ejecutar modelos de 70B en FP16 en una sola tarjeta y caben modelos de 100B+ en Q4. También admite Universal MIG para particionar la GPU en múltiples instancias de inferencia aisladas.

Beyond LLMs

AI Capability Matrix

What AI tasks this GPU can handle — from text generation to image and video creation.

CapabilityStatusRepresentative Model
LLM Chat (7B)Runs nativelyLlama 3.1 8B Q4
LLM Coding (30B)Runs nativelyQwen 3 30B Q4
LLM Large (70B)Runs nativelyLlama 3.1 70B Q4
Image Gen (SDXL)Runs nativelySDXL 1.0 FP16
Image Gen (Flux)Runs nativelyFlux.1 Dev FP16
Image Gen (SD 3.5)Runs nativelySD 3.5 Large FP16
Video Short (25f)Runs nativelyLTX Video 2B
Video Long (100f)Tight fitWan Video 14B
workstation-gradeecc-memorylarge-vramprofessional-certifiedblackwellmig-support

Especificaciones

Cómputo
FP16125 TFLOPS
INT84000 TOPS
ArquitecturaBlackwell
Memoria
VRAM96 GB
Ancho de banda1792 GB/s
General
FamiliaRTX PRO Blackwell
SegmentoWorkstation
InterconexiónPCIe 5
Plataforma de cómputoCUDA
MSRP$9,999

Características clave

96 GB ECC GDDR7 VRAM on a 512-bit busBlackwell GB202 die: 24,064 CUDA cores, 752 Tensor Cores5th-gen Tensor Cores with FP4, FP8, FP16 precision125 TFLOPS FP16 / 4,000 INT8 TOPS1,792 GB/s memory bandwidthUniversal MIG support for isolated multi-tenant inferencePCIe 5.0 x16 with up to 600W TDP

Para cargas de trabajo de IA

Fortalezas
  • 96 GB ECC VRAM fits 70B models at FP16 and 100B+ models at Q4 on a single workstation card
  • 1,792 GB/s bandwidth delivers fast decode throughput even for unquantized 70B inference
  • Universal MIG partitioning allows multiple isolated AI workloads on one GPU — practical for shared workstation deployments
  • 4,000 INT8 TOPS and FP4 support make it one of the most capable inference platforms outside dedicated data-center hardware
Consideraciones
  • $9,999 MSRP is approaching data-center GPU territory — the H100 SXM becomes competitive at scale
  • 600W TDP requires workstation-class chassis and power delivery
  • Massive overkill for models under 30B — most of the VRAM advantage only matters for 70B+ deployments
  • Single-card throughput for 70B FP16 is still slower than H100/H200 data-center cards despite the large VRAM

Architecture

Blackwell

Blackwell is NVIDIA's fifth-generation RTX architecture, built on TSMC's 4NP process. It introduces 5th-generation Tensor Cores with native FP4 precision support, enabling double the inference throughput per watt compared to Ada Lovelace's FP8 operations. Key innovations include the Neural Rendering Pipeline for AI-driven shading and the debut of GDDR7 memory in consumer GPUs.

AI Relevance

FP4 Tensor Cores deliver the highest tokens-per-watt efficiency in any consumer architecture. Native FP4 quantization means models can run at lower precision with minimal quality loss, effectively doubling the effective VRAM for model weights.

Process: TSMC 4NPPlatform: CUDATensor Cores: Gen 5Precisions: FP32, FP16, BF16, FP8, FP4, INT8, INT4

Consejo de compra

¿Deberías comprar RTX PRO 6000 Blackwell Workstation Edition 96GB para IA local?

Excelente opción para IA local

Ejecuta 36 de 50 modelos principales bien — un todoterreno sólido para inferencia local.

96.0 GB

VRAM

$9,999

PVP

$104/GB

Coste por GB de VRAM

Mejores modelos para esta GPU

What will limit you first

Este setup está bastante equilibrado para este modelo.

No hay grandes señales de alerta

Esta recomendación tiene margen de memoria suficiente y una velocidad estimada razonable para la carga de trabajo seleccionada.

Best upgrade itinerary

Desbloquea 2 modelos adicionales que hoy no caben en tu setup.

¿Quieres más margen? NVIDIA H200 141GB (141.0 GB VRAM) es el siguiente paso.

Recommendations by Workload

Chat

S

Qwen3-Coder-Next

This model is still usable for chat, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 101.7 tok/s · 256K ctx · llama.cppEST.
60.0 GB / 96.0 GB VRAM

Coding

S

Qwen3-Coder-Next

This model is a direct match for coding. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 101.7 tok/s · 256K ctx · llama.cppEST.
60.8 GB / 96.0 GB VRAM

Agentic Coding

S

Qwen3-Coder-Next

This model is still usable for agentic-coding, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 101.7 tok/s · 256K ctx · llama.cppEST.
62.2 GB / 96.0 GB VRAM

Reasoning

S

Qwen3-Coder-Next

This model is a direct match for reasoning. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 101.7 tok/s · 256K ctx · llama.cppEST.
60.8 GB / 96.0 GB VRAM

RAG

S

Qwen 3.5 27B

This model is a direct match for rag. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 98.7 tok/s · 131K ctx · llama.cppEST.
33.3 GB / 96.0 GB VRAM

Full Model Compatibility

AlibabaQwen3-Coder-Next
S95
80B60.8 GB102 tok/s256K ctx
moe
AlibabaQwen 3.5 122B A10B
S95
122B87.4 GB61 tok/s73K ctx
moe
MistralMistral Small 4 119B
S93
119B88.5 GB66 tok/s38K ctx
moe
AlibabaQwen 2.5 VL 72B
S93
72B59.3 GB37 tok/s33K ctx
dense
MistralDevstral 2 123B Instruct
S92
123B90.9 GB22 tok/s31K ctx
dense
AlibabaQwen 3.6 35B A3B
S92
35B36.0 GB191 tok/s250K ctx
+1moe
AlibabaQwen3-Coder 30B A3B Instruct
S92
30.5B30.6 GB228 tok/s256K ctx
moe
AlibabaQwen 3.5 27B
S91
27B30.1 GB99 tok/s131K ctx
dense
AlibabaQwen3-VL 30B A3B Instruct
S91
30B30.3 GB235 tok/s256K ctx
moe
AlibabaQwen 3.5 35B A3B
S91
35B33.3 GB208 tok/s131K ctx
moe
AlibabaQwen 3 32B
S90
32B33.9 GB84 tok/s131K ctx
dense
CohereCommand A 111B
S90
111B82.1 GB24 tok/s73K ctx
dense
OpenAIGPT-OSS 120B
S90
117B86.8 GB23 tok/s46K ctx
dense
MistralMagistral Small 2507
S89
24B27.6 GB111 tok/s131K ctx
dense
MistralDevstral Small 2 24B Instruct
S89
24B27.6 GB111 tok/s256K ctx
dense
AlibabaQwen 3.6 27B
S89
27B27.9 GB62 tok/s262K ctx
+1dense
AlibabaQwen 3 30B A3B
S89
30.5B30.6 GB228 tok/s131K ctx
moe
NVIDIANemotron 3 Nano 30B
S89
30B31.2 GB88 tok/s131K ctx
dense
Mistral AIPixtral Large 124B
S89
124B91.5 GB22 tok/s29K ctx
dense
MistralLeanstral 119B A6B
S88
119B91.9 GB60 tok/s24K ctx
moe
MistralDevstral Small 1.1
S88
24B27.6 GB111 tok/s131K ctx
dense
AlibabaQwen 3.5 9B
S88
9B18.2 GB126 tok/s131K ctx
dense
AlibabaQwen 3 14B
S87
14B21.5 GB190 tok/s131K ctx
dense
GoogleGemma 4 31B
S87
30.7B43.9 GB52 tok/s73K ctx
dense
NVIDIANemotron Cascade 2 30B A3B
S87
30B31.7 GB233 tok/s262K ctx
moe
MicrosoftPhi-4-reasoning-plus 14B
S87
14.7B22.5 GB181 tok/s33K ctx
dense
OpenAIGPT-OSS 20B
S86
21B25.8 GB289 tok/s128K ctx
moe
AlibabaQwen 3 8B
S86
8B17.6 GB112 tok/s131K ctx
dense
LG AIEXAONE 4.0 32B
A84
32B33.9 GB83 tok/s131K ctx
dense
AlibabaQwen 3.5 4B
A84
4B15.1 GB56 tok/s131K ctx
dense
GoogleGemma 4 26B A4B
A83
25.2B29.5 GB244 tok/s256K ctx
moe
MistralMinistral 3 14B
A82
14B21.5 GB190 tok/s262K ctx
multimodal
NVIDIANemotron Nano 8B
A81
8B17.3 GB112 tok/s131K ctx
dense
MicrosoftPhi-4 Mini Reasoning 4B
A80
3.8B14.3 GB53 tok/s131K ctx
dense
Jina AIJina Embeddings v3
A74
0.57B13.6 GB8 tok/s8K ctx
dense
BAAIBGE M3
A73
0.57B12.8 GB8 tok/s8K ctx
dense
AlibabaQwen 3.5 397B A17B
F0
397B255.5 GB3 tok/s4K ctx
moe
Moonshot AIKimi K2.5
F0
1000B627.9 GB2 tok/s4K ctx
moe
Moonshot AIKimi K2.6
F0
1000B627.9 GB2 tok/s4K ctx
+1moe
DeepSeekDeepSeek V4 Pro
F0
1600B874.4 GB2 tok/s4K ctx
moe
DeepSeekDeepSeek V4 Flash
F0
284B169.8 GB8 tok/s4K ctx
moe
Z.aiGLM-5.1
F0
754B489.5 GB2 tok/s4K ctx
moe
Z.aiGLM-5
F0
744B483.4 GB2 tok/s4K ctx
moe
DeepSeekDeepSeek V3.2
F0
671B420.3 GB2 tok/s4K ctx
moe
AlibabaQwen 3 235B A22B
F0
235B156.7 GB9 tok/s4K ctx
moe
AlibabaQwen3-Coder 480B A35B Instruct
F0
480B306.2 GB2 tok/s4K ctx
moe
MiniMax M2.7
F0
230B154.6 GB10 tok/s4K ctx
moe
DeepSeekDeepSeek Coder V2 236B
F0
236B213.1 GB4 tok/s4K ctx
moe
DeepSeekDeepSeek R1 671B
F0
671B479.4 GB2 tok/s4K ctx
moe
DeepSeekDeepSeek V3.1 671B
F0
671B479.4 GB2 tok/s4K ctx
moe

Casi al alcance

Modelos que podrías ejecutar con una mejora

Modelos de alta calidad que necesitan un poco más de memoria

Image & Video Generation

Diffusion Model Compatibility

51 of 52 models can generate images or video on your RTX PRO 6000 Blackwell Workstation Edition 96GB

ModelMax ResolutionGen TimeGrade
SD TurboImage512×512300msS
Stable Diffusion 1.5Image512×768600msS
Realistic Vision v5.1Image512×768600msS
DreamShaper 8Image512×768600msS
LCM DreamShaper v7Image512×768200msS
PixArt-SigmaImage1024×1024~2.4sS
FramePack I2VVideo1280×720~4.4s/frameS
SDXL TurboImage512×512300msS
SDXL LightningImage1024×1024900msS
Stable Diffusion XL 1.0Image1024×1024~2.4sS
Playground v2.5Image1024×1024~3.6sS
RealVisXL v5.0Image1024×1024~2.7sS
DreamShaper XLImage1024×1024~2.7sS
Juggernaut XL v9Image1024×1024~2.7sS
Animagine XL 3.1Image1024×1024~2.7sS
Pony Diffusion V6 XLImage1024×1024~2.7sS
Animagine XL 4.0Image1024×1024~2.7sS
Illustrious XLImage1024×1024~2.7sS
Wan Video 2.1 1.3BVideo480×832~1.7s/frameS
Stable Diffusion 3.5 MediumImage1024×1024~4.2sS
Flux.2 Klein 4BImage1024×1024700msS
LTX Video 2BVideo1280×720~2.1s/frameS
KolorsImage1024×1024~4.7sS
Stable CascadeImage1024×1024~5.9sS
AuraFlow v0.3Image1536×1536~10.7sS
Stable Diffusion 3.5 LargeImage1024×1024~13.1sS
Stable Diffusion 3.5 Large TurboImage1024×1024~2.4sS
CogVideoX 2BVideo720×480~2.1s/frameS
HunyuanVideoVideo720×1280~4.4s/frameS
ChromaImage1024×1024~2.4sS
Z-Image TurboImage1536×1536~2.4sS
Flux.1 DevImage1024×1024~10.7sS
Flux.1 SchnellImage1024×1024~2.1sS
LTX Video 13BVideo1280×720~4.4s/frameS
Flux.1 Kontext DevImage1024×1024~11.9sS
AnimateDiff v1.5.3Video512×768~1.1s/frameS
Cosmos Diffusion 7BVideo1024×576~3.4s/frameS
CogVideoX 5BVideo720×480~3s/frameS
Wan2.2 TI2V 5BVideo832×480~3s/frameS
Flux.2 Klein 9BImage1024×1024~1.2sS
Flux.1 Fill DevImage1024×1024~10.1sS
Mochi 1 PreviewVideo848×480~3.9s/frameS
HunyuanVideo 1.5Video720×1280~3.6s/frameS
Helios 14BVideo1280×720~4.5s/frameS
SkyReels V2 14BVideo1280×720~4.5s/frameS
Wan Video 2.1 14BVideo720×1280~4.5s/frameS
Wan Video 2.2 14BVideo720×1280~4.5s/frameS
Qwen ImageImage1024×1024~4sS
Qwen Image EditImage1024×1024~4sS
Flux.2 DevImage1024×1024~1m 52sS
MAGI-1Video1280×720~5.6s/frameS
HunyuanImage 3.0Image256×256~7sF

Image models estimated at 1024×1024 (28 steps, FP16). Video models estimated at 768×512 (25 frames, 30 steps, FP16). Actual performance varies with runtime and system load.

Upgrade paths

Upgrade from RTX PRO 6000 Blackwell Workstation Edition 96GB

See what you unlock with more powerful hardware

Opciones de mejora

Opciones de mejora

NVIDIANVIDIA H200 141GBSiguiente nivel
141 GB VRAM (+45)4800 GB/s (+3008)
B
Desbloquea 2 modelos adicionales que hoy no caben en tu setup.Desbloquea Qwen 3 235B A22B, MiniMax M2.7+47% más rápido promedio

Desbloquea 2 modelos adicionales que hoy no caben en tu setup.

Eleva la velocidad media de decodificación en torno a un 47% en los modelos que sí caben.

~$30,000 MSRP

NVIDIANVIDIA B200 180GBMejora NVIDIA
180 GB VRAM (+84)8000 GB/s (+6208)
B
Desbloquea 8 modelos adicionales que hoy no caben en tu setup.Desbloquea DeepSeek V4 Flash, Qwen 3 235B A22B, MiniMax M2.7+5 más · +80% más rápido promedio

Desbloquea 8 modelos adicionales que hoy no caben en tu setup.

Eleva la velocidad media de decodificación en torno a un 80% en los modelos que sí caben.

~$30,000 MSRP

AMD Instinct MI325X 256GBMayor salto
256 GB VRAM (+160)6000 GB/s (+4208)
B
Desbloquea 12 modelos adicionales que hoy no caben en tu setup.Desbloquea Qwen 3.5 397B A17B, DeepSeek V4 Flash, Qwen 3 235B A22B+9 más · +50% más rápido promedio

Desbloquea 12 modelos adicionales que hoy no caben en tu setup.

Eleva la velocidad media de decodificación en torno a un 50% en los modelos que sí caben.

~$20,000 MSRP

AMD Instinct MI350X 288GBMejor relación calidad-precio
288 GB VRAM (+192)8000 GB/s (+6208)
B
Desbloquea 13 modelos adicionales que hoy no caben en tu setup.Desbloquea Qwen 3.5 397B A17B, DeepSeek V4 Flash, Qwen 3 235B A22B+10 más · +69% más rápido promedio

Desbloquea 13 modelos adicionales que hoy no caben en tu setup.

Eleva la velocidad media de decodificación en torno a un 69% en los modelos que sí caben.

~$8,000 MSRP

Frequently Asked Questions

What AI models can I run on RTX PRO 6000 Blackwell Workstation Edition 96GB?

RTX PRO 6000 Blackwell Workstation Edition 96GB (96 GB VRAM) can run these top models: Qwen3-Coder-Next (score: 95/100), Qwen 3.5 122B A10B (score: 95/100), Mistral Small 4 119B (score: 93/100). See the full compatibility list above.

How much VRAM does RTX PRO 6000 Blackwell Workstation Edition 96GB have for AI?

RTX PRO 6000 Blackwell Workstation Edition 96GB has 96 GB of VRAM available for AI model inference. This determines which models and quantization levels you can run locally.

Is RTX PRO 6000 Blackwell Workstation Edition 96GB good for running LLMs locally?

Yes, RTX PRO 6000 Blackwell Workstation Edition 96GB is excellent for running LLMs locally with top compatibility scores above 80/100.

What is the best model for RTX PRO 6000 Blackwell Workstation Edition 96GB for coding?

For coding on RTX PRO 6000 Blackwell Workstation Edition 96GB, we recommend Qwen3-Coder-Next. It achieves 101.7 tokens per second with 256K context window. This model is a direct match for coding. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Should I upgrade from RTX PRO 6000 Blackwell Workstation Edition 96GB?

There are 4 upgrade path(s) from RTX PRO 6000 Blackwell Workstation Edition 96GB: NVIDIA H200 141GB, NVIDIA B200 180GB. Upgrading would unlock larger models and faster inference speeds.

Can RTX PRO 6000 Blackwell Workstation Edition 96GB run Flux for image generation?

Yes, RTX PRO 6000 Blackwell Workstation Edition 96GB with 96 GB of usable memory can run Flux.1 Dev at FP16 natively. Flux is a 12B parameter diffusion transformer that produces high-quality images. You can also run the Schnell variant for faster generation.

What image and video AI models can I run on RTX PRO 6000 Blackwell Workstation Edition 96GB?

RTX PRO 6000 Blackwell Workstation Edition 96GB (96 GB VRAM) can handle various AI generation tasks beyond LLMs. For image generation, SDXL and Stable Diffusion 3.5 run well. Flux.1 Dev also runs natively for state-of-the-art image quality. For video, LTX Video 2.3 can generate short clips. Check the AI Capability Matrix above for detailed compatibility.

Is RTX PRO 6000 Blackwell Workstation Edition 96GB good for AI image generation?

RTX PRO 6000 Blackwell Workstation Edition 96GB is excellent for AI image generation. With 96 GB of usable memory, it runs all major diffusion models including Flux.1, SDXL, and Stable Diffusion 3.5 at full precision. You can generate high-resolution images quickly and even handle video generation models.

Can RTX PRO 6000 Blackwell Workstation Edition 96GB run Qwen 3.5 27B?

Yes, RTX PRO 6000 Blackwell Workstation Edition 96GB with 96 GB of usable memory can run Qwen 3.5 27B at Q8 (near-lossless, ~28.9 GB) or even FP16 (~55.4 GB) depending on your context needs. This setup provides an excellent experience with this model. Use Ollama or vLLM for best results.

What is the best quantization for AI models on RTX PRO 6000 Blackwell Workstation Edition 96GB?

With 96 GB VRAM on RTX PRO 6000 Blackwell Workstation Edition 96GB, use Q8_0 for most models — it is near-lossless and you have the memory for it. For 70B+ models, Q6_K offers excellent quality. Reserve Q4_K_M for 100B+ models or when you need maximum context length.

For local LLMs on RTX PRO 6000 Blackwell Workstation Edition 96GB, does VRAM matter more than bandwidth?

RTX PRO 6000 Blackwell Workstation Edition 96GB already has strong memory bandwidth, so the next limit is often memory capacity and context headroom rather than raw decode speed. For local LLMs, fit first and bandwidth second is the right mental model.

Compare with similar