Will It Run AI
ACodeLlama 13B Instruct on NVIDIA L4 24GB
98% VRAM  ·  23.4 GB / 24.0 GB
Speed 26 tok/s·Quant Q4_K_M·Partial Offload
Check on willitrunai.com