willitrun·ai

Swiss AI

Apertus v1.5 8B

当前
602下载量23点赞Jul 2026发布日期262K tokens上下文Apache 2.0许可证58 良好质量

Apertus v1.5 8B (8.899999618530273B parameters) requires approximately 8.9 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 11 GB of VRAM.

快速开始

— 复制粘贴即可本地运行

Copy-paste commands to run Apertus v1.5 8B on your machine.

Run

docker run --rm -it ghcr.io/ggerganov/llama.cpp:full \ --hf-repo "swiss-ai/Apertus-v1.5-8B" \ --hf-file "Apertus-v1.5-8B-Q4_K_M.gguf" \ -c 4096 -ngl 99

Quick specs

Parameters8.9B
Architecturedense
Context262K tokens
Modalitytext+vision
Min RAM3.5 GB
Rec. RAM5.4 GB (Q4_K_M)
LicenseApache 2.0
FamilyApertus
Chat

About this model

Apertus 1.5 8B is the compact member of Switzerland's fully open Apertus family, the result of continued pretraining of Apertus 1.0 with a 4T-token multimodal mix on top of 19T pretraining tokens. A decoder-only transformer with the xIELU activation, it delivers multilingual and vision-capable performance at a size that fits a single consumer GPU, with a 262K context.

  • 8.9B dense including a ~294M vision encoder — runs on a single consumer GPU at Q4.
  • Fully open training data, weights and documentation.
  • 262,144-token context window.
  • 19T pretraining tokens plus a 4T-token multimodal continued-pretraining mix.
  • Apache 2.0, developed by the Swiss AI initiative (EPFL / ETH Zurich).

相关模型

你的硬件

检测中...

快速推荐

最佳硬件

Apertus v1.5 8B 的最佳选择

运行此模型

量化选项

各量化级别的 VRAM 估算

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q1_0_G128
1.125
1.3 GB
Very Low
Q2_0_G128
1.71
2.4 GB
Low
Q2_K
2
3.5 GB
Low
Q3_K_S
3
4.4 GB
Low
NVFP4
4
5.0 GB
Medium
Q4_K_M
4
5.4 GB
Medium
Q5_K_M
5
6.4 GB
High
Q6_K
6
7.3 GB
High
Q8_0
8
9.5 GB
Very High
F16
16
18.2 GB
Maximum

硬件兼容性

全部硬件的适配估算

打开计算器

Computing compatibility...

内存详细分析

Reference: RTX 2060 6GB

Weights5.4 GB
KV Cache2.0 GB
Runtime0.9 GB
Headroom0.6 GB

常见问题

FAQ — Apertus v1.5 8B

另请参阅