Will It Run AI
CDolphin3.0 Llama3.1 8B on Quadro RTX 6000 24GB
39% VRAM  ·  9.4 GB / 24.0 GB
Speed 95 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com