Will It Run AI
ACodeLlama 7B Instruct on NVIDIA A100 40GB
43% VRAM  ·  17.3 GB / 40.0 GB
Speed 98 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com