Will It Run AI
ACodeLlama 13B Instruct on RTX 3090 Ti 24GB
99% VRAM  ·  23.7 GB / 24.0 GB
Speed 90 tok/s·Quant Q4_K_M·Partial Offload
Check on willitrunai.com