Will It Run AI
Cstabilityai japanese stablelm base gamma 7b on RTX 4500 Ada 24GB
36% VRAM  ·  8.7 GB / 24.0 GB
Speed 80 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com