Will It Run AI
ALlama 3.1 405B on H100 NVL 188GB
99% VRAM  ·  185.3 GB / 188.0 GB
Speed 37 tok/s·Quant Q2_K·Partial Offload
Check on willitrunai.com