Will It Run AI
CInternLM Chat 7B on RTX A2000 12GB
100% VRAM  ·  14.2 GB / 12.0 GB
Speed 28 tok/s·Quant Q4_K_M·Very Compromised
Check on willitrunai.com