Will It Run AI
COpenHermes 2.5 7B on NVIDIA L4 24GB
41% VRAM  ·  9.8 GB / 24.0 GB
Speed 49 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com