Your model
Presets
Result
Custom model
–
GB of memory the model needs in total
Weights are the trained brain of the model, context memory grows with the conversation, and every runtime needs about 1.5 GB of overhead. A device must keep 10 % of its memory free.
Expert details
| Component | GB |
|---|
| Device | Usable (0.9 × D) | Headroom | Verdict |
|---|