Will It Run AI
Cdolphin 2.9.4 llama3.1 8b on RTX 3060 12GB
68% VRAM  ·  8.2 GB / 12.0 GB
Speed 49 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com