Will It Run AI
Cdolphin 2.9.4 llama3.1 8b on RTX 4060 Ti 8GB
98% VRAM  ·  7.8 GB / 8.0 GB
Speed 43 tok/s·Quant Q4_K_M·Partial Offload
Check on willitrunai.com