Defog

SQLCoder 7B

Name: SQLCoder 7B
Rating: 80 (185 reviews)
Author: Defog

現行

HuggingFace

Ollama

26.3Kダウンロード432いいねDec 2023公開日8K トークンコンテキストApache 2.0ライセンス70 優秀品質

SQLCoder 7B (7B parameters) requires approximately 8.0 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 10 GB of VRAM.

はじめに

— コピー&ペーストでローカル実行

Copy-paste commands to run SQLCoder 7B on your machine.

Run

ollama run sqlcoder

Quick specs

Parameters7B

Architecturedense

Context8K tokens

Modalitytext

Min RAM2.7 GB

Rec. RAM4.3 GB (Q4_K_M)

LicenseApache 2.0

FamilySQLCoder

About this model

The model weights were updated at 7 AM UTC on Feb 7, 2024. The new model weights lead to a much more performant model – particularly for joins.

•Developed by:: Defog, Inc
•Model type:: [Text to SQL]
•License:: [CC-by-SA-4.0]
•Finetuned from model:: [CodeLlama-7B]

SQLCoder 7Bのおすすめ

このモデルを実行

SQLCoder 7B on RTX 3080 Ti 12GB SQLCoder 7B on RTX 4070 12GB SQLCoder 7B on RTX 4070 Super 12GB

量子化オプション

量子化レベル別VRAM推定値

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	2.7 GB	Low	—
Q3_K_S	3	3.4 GB	Low	—
NVFP4	4	3.9 GB	Medium	—
Q4_K_M	4	4.3 GB	Medium	—
Q5_K_M	5	5.0 GB	High	—
Q6_K	6	5.7 GB	High	—
Q8_0	8	7.5 GB	Very High	—
F16	16	14.3 GB	Maximum	—

ハードウェア互換性

全ハードウェアの適合度推定

カリキュレーターを開く

Computing compatibility...

メモリ内訳

Reference: RTX 2060 6GB

Weights4.3 GB

KV Cache2.0 GB

Runtime1.2 GB

Headroom0.6 GB

よくある質問

SQLCoder 7B

SQLCoder 7Bのおすすめ

量子化レベル別VRAM推定値

全ハードウェアの適合度推定

Reference: RTX 2060 6GB

FAQ — SQLCoder 7B