Will It Run AI
Cvntl llama3 8b v2 on RTX A4000 16GB
54% VRAM  ·  8.6 GB / 16.0 GB
Speed 64 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com