Will It Run AI
CDolphin3.0 Llama3.1 8B on Tesla P100 16GB
54% VRAM  ·  8.6 GB / 16.0 GB
Speed 89 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com