Foundation AI

Antares 350M

Name: Antares 350M
Rating: 50 (196 reviews)
Author: Foundation AI

Aktuell

HuggingFace

1.2KDownloads50LikesJul 2026Veröffentlicht33K TokenKontextApache 2.0Lizenz31 BasisQualität

Antares 350M (0.3499999940395355B parameters) requires approximately 2.4 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 3 GB of VRAM.

Loslegen

— kopieren & einfügen, um lokal auszuführen

Copy-paste commands to run Antares 350M on your machine.

Run

docker run --rm -it ghcr.io/ggerganov/llama.cpp:full \
  --hf-repo "fdtn-ai/antares-350m" \
  --hf-file "antares-350m-Q4_K_M.gguf" \
  -c 4096 -ngl 99

Quick specs

Parameters0.35B

Architecturedense

Context33K tokens

Modalitytext

Min RAM0.1 GB

Rec. RAM0.2 GB (Q4_K_M)

LicenseApache 2.0

FamilyAntares

About this model

Antares 350M is the smallest member of Foundation AI's security-focused Antares family, post-trained on IBM's Granite 4.0 350M. At 0.35B parameters it is designed for embedded and always-on security agent workloads that must run on CPU with a minimal memory budget.

•0.35B parameters — under 300MB at Q4, runs on almost anything.
•Security and vulnerability-detection focus, same recipe as Antares 1B.
•Built on IBM Granite 4.0 350M.
•32,768-token context.
•Apache 2.0 licensed.

Verwandte Modelle

Schnellauswahl

Bestes BudgetC

Intel Arc A380 6GB~$139 — 5 tok/s

Beste GesamtwahlB

GTX 1650 4GB~$149 — 5 tok/s

Beste Hardware

Top-Empfehlungen für Antares 350M

GTX 1650 4GBB

4 GB

RTX 3050 Ti Laptop 4GBB

Dieses Modell ausführen

Antares 350M on GTX 1650 4GB Antares 350M on RTX 3050 Ti Laptop 4GB Antares 350M on Intel Arc A370M 4GB

Quantisierungsoptionen

VRAM-Schätzungen nach Quantisierungsstufe

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q1_0_G128	1.125	0.1 GB	Very Low	—
Q2_0_G128	1.71	0.1 GB	Low	—
Q2_K	2	0.1 GB	Low	—
Q3_K_S	3	0.2 GB	Low	—
NVFP4	4	0.2 GB	Medium	—
Q4_K_M	4	0.2 GB	Medium	—
Q5_K_M	5	0.3 GB	High	—
Q6_K	6	0.3 GB	High	—
Q8_0	8	0.4 GB	Very High	—
F16	16	0.7 GB	Maximum	—

Hardware-Kompatibilität

Eignungsschätzungen für alle Hardware

Rechner öffnen

Computing compatibility...

Speicheraufschlüsselung

Reference: RTX 2060 6GB

Weights0.2 GB

KV Cache0.4 GB

Runtime1.2 GB

Headroom0.6 GB

Häufig gestellte Fragen

FAQ — Antares 350M

Siehe auch

Quantisierungsleitfaden Bewertungsmethodik Rechner öffnen