Can Flux.1 Dev run on Gaudi 3 128GB?
YES — Runs Great
S90Excellent
Flux.1 Dev needs ~24.0 GB VRAM. Gaudi 3 128GB has 128.0 GB.
| Precision | VRAM Needed | Status | Grade |
|---|---|---|---|
| FP16Best | 24.0 GB | Runs natively | S |
| FP8 | 13.0 GB | Runs natively | S |
24.0 GB required128.0 GB available
19% VRAM used
Parameters
12B
Precision
FP16
Max Resolution
1024×1024
VRAM
24.0 GB / 128.0 GB
Gen Time
~1.8s
Performance by workload
| Workload | Grade | Fit | VRAM | Gen Time |
|---|---|---|---|---|
| Quick | S | Runs natively | 23.6 GB | ~1.8s |
| Standard | S | Runs natively | 24.0 GB | ~1.8s |
| High Quality | S | Runs natively | 24.0 GB | ~1.8s |
Resolution compatibility
How Flux.1 Dev (12B params) performs at each resolution on Gaudi 3 128GB (128.0 GB usable).
| Resolution | VRAM Required | Gaudi 3 128GB |
|---|---|---|
| 512×512 | 23.6 GB | S● |
| 768×768 | 23.8 GB | S● |
| 1024×1024 | 24.0 GB | S● |
Memory breakdown
Required: 24.0 GBAvailable: 128.0 GB
Weights24.0 GB
VAE0.2 GB
Text Encoder9.6 GB
Activations0.8 GB
Overhead0.5 GB
Frequently asked questions
Can Gaudi 3 128GB run Flux.1 Dev?
Yes, Gaudi 3 128GB can run Flux.1 Dev for image generation. Runs natively.
How much VRAM does Flux.1 Dev need?
Flux.1 Dev (12B parameters) requires approximately 24.0 GB at FP16. Gaudi 3 128GB provides 128.0 GB.
What resolution can Flux.1 Dev produce on Gaudi 3 128GB?
On Gaudi 3 128GB, Flux.1 Dev can generate images at up to 1024x1024. Generation time is approximately 1.8 seconds per image.
Embed this result▼
Paste this snippet into any page to show a live fit card.
<iframe src="https://willitrunai.com/embed/flux-1-dev-on-gaudi-3-128gb" width="400" height="180" frameborder="0" style="border:none;border-radius:12px;overflow:hidden;" title="Will It Run AI — fit result"></iframe>
Preview: