Will It Run AI
Cfalcon mamba 7b instruct Q4 K M on NVIDIA L4 24GB
35% VRAM  ·  8.4 GB / 24.0 GB
Speed 53 tok/s·Quant Q4_K_M·Runs Great
Check on willitrunai.com