
Unified memory★ Popular pick
Mac Studio M5 Ultra
96 GB$5500~72.0 GB usable
- Type
- Unified memory (SoC)
- Provider
- Apple ★
- Unified memory
- 96 GB
- Price
- $5500
Usable for models (est.): 72.0 GB · Price per GB: $57
Popular models that run here
The largest models this device holds fully in memory, each at its best-fitting quantization.
Qwen 3 235B-A22B (MoE)235B parametersBest fit: INT2
Mistral Large 2 (MoE)141B parametersBest fit: INT2
Qwen 2.5 72B72B parametersBest fit: FP4
Llama 3 70B70.6B parametersBest fit: FP4
Llama 3.3 70B70.6B parametersBest fit: FP4
Llama 3.1 70B70B parametersBest fit: FP4
Llama 2 70B70B parametersBest fit: FP4
Falcon 40B40B parametersBest fit: FP8
Every model: does it fit?
37 of 41 models run fully in memory, 2 more with partial offload. Estimated at a 4096-token context. How fit is calculated
| Model | Params | Best fit | Memory needed (est.) | Fit |
|---|---|---|---|---|
| DeepSeek-V4-Pro (MoE) | 1600B | — | ~480.0 GB | ✕ Does not fit |
| DeepSeek-V3 (MoE) | 671B | — | ~201.3 GB | ✕ Does not fit |
| Llama 3.1 405B | 405B | — | ~121.5 GB | ◐ Partial offload |
| DeepSeek-V4-Flash (MoE) | 284B | — | ~85.2 GB | ◐ Partial offload |
| Qwen 3 235B-A22B (MoE) | 235B | INT2 | ~70.5 GB | ✓ Runs |
| Mistral Large 2 (MoE) | 141B | INT2 | ~42.3 GB | ✓ Runs |
| Qwen 2.5 72B | 72B | FP4 | ~43.2 GB | ✓ Runs |
| Llama 3 70B | 70.6B | FP4 | ~42.4 GB | ✓ Runs |
| Llama 3.3 70B | 70.6B | FP4 | ~42.4 GB | ✓ Runs |
| Llama 3.1 70B | 70B | FP4 | ~42.0 GB | ✓ Runs |
| Llama 2 70B | 70B | FP4 | ~42.0 GB | ✓ Runs |
| Falcon 40B | 40B | FP8 | ~48.0 GB | ✓ Runs |
| Qwen 2.5 32B | 32B | FP8 | ~38.4 GB | ✓ Runs |
| Qwen 3 32B | 32B | FP8 | ~38.4 GB | ✓ Runs |
| OLMo 3 32B | 32B | FP8 | ~38.4 GB | ✓ Runs |
| Gemma 4 31B | 31B | FP8 | ~37.2 GB | ✓ Runs |
| Qwen 3 30B-A3B (MoE) | 30B | FP16 | ~72.0 GB | ✓ Runs |
| Gemma 3 27B | 27B | FP16 | ~64.8 GB | ✓ Runs |
| Phi-4 | 14B | FP32 | ~67.2 GB | ✓ Runs |
| Llama 2 13B | 13B | FP32 | ~62.4 GB | ✓ Runs |
| OLMo 2 13B | 13B | FP32 | ~62.4 GB | ✓ Runs |
| Mistral Nemo 12B | 12B | FP32 | ~57.6 GB | ✓ Runs |
| Gemma 3 12B | 12B | FP32 | ~57.6 GB | ✓ Runs |
| Gemma 2 9B | 9B | FP32 | ~43.2 GB | ✓ Runs |
| Llama 3 8B | 8B | FP32 | ~38.4 GB | ✓ Runs |
| Llama 3.1 8B | 8B | FP32 | ~38.4 GB | ✓ Runs |
| Qwen 3 8B | 8B | FP32 | ~38.4 GB | ✓ Runs |
| Llama 3.3 8B | 8B | FP32 | ~38.4 GB | ✓ Runs |
| Llama 2 7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| Mistral 7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| Qwen 2.5 7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| Falcon 7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| OLMo 2 7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| OLMo-7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| Mistral Small 3 7B | 7B | FP32 | ~33.6 GB | ✓ Runs |
| Gemma 3 4B | 4B | FP32 | ~19.2 GB | ✓ Runs |
| Phi-3 | 3.8B | FP32 | ~18.2 GB | ✓ Runs |
| Phi-3-mini-128K | 3.8B | FP32 | ~18.2 GB | ✓ Runs |
| Llama 3.2 3B | 3B | FP32 | ~14.4 GB | ✓ Runs |
| Llama 3.2 1B | 1B | FP32 | ~4.8 GB | ✓ Runs |
| Gemma 3 1B | 1B | FP32 | ~4.8 GB | ✓ Runs |
Measured throughput
| Model | Quantization | Tokens/sec (measured) |
|---|---|---|
| DeepSeek-V4-Flash (MoE) | Q4_K_M | 47 |
| Llama 3.2 7B | Q4_K_M | 44 |
| Gemma 3 27B | Q4_K_M | 24 |
| Qwen 3 32B | Q4_K_M | 18 |
| Llama 3.3 70B | Q4_K_M | 14 |
Similar unified-memory machines
- Mac Mini M4 (16 GB)
- Mac Mini M4 32GB (32 GB)
- Mac Mini M4 Pro (24 GB)
- Mac Studio M5 Max (36 GB)
- MacBook Pro M4 14-inch (16 GB)
- MacBook Pro M4 Max 16-inch (48 GB)
- MacBook Air M3 13-inch (8 GB)
- MacBook Air M4 13-inch (16 GB)
Alternatives with similar memory
- NVIDIA H100 NVL (94 GB)
- NVIDIA A100 80GB PCIe (80 GB)
- NVIDIA H100 PCIe (80 GB)
- NVIDIA H100 SXM (80 GB)