Back to Hardware
Mac Studio M5 Ultra

Unified memory★ Popular pick

Mac Studio M5 Ultra

96 GB$5500~72.0 GB usable

Type
Unified memory (SoC)
Provider
Apple ★
Unified memory
96 GB
Price
$5500

Usable for models (est.): 72.0 GB · Price per GB: $57

Popular models that run here

The largest models this device holds fully in memory, each at its best-fitting quantization.

Every model: does it fit?

37 of 41 models run fully in memory, 2 more with partial offload. Estimated at a 4096-token context. How fit is calculated

ModelParamsBest fitMemory needed (est.)Fit
DeepSeek-V4-Pro (MoE)1600B—~480.0 GB✕ Does not fit
DeepSeek-V3 (MoE)671B—~201.3 GB✕ Does not fit
Llama 3.1 405B405B—~121.5 GB◐ Partial offload
DeepSeek-V4-Flash (MoE)284B—~85.2 GB◐ Partial offload
Qwen 3 235B-A22B (MoE)235BINT2~70.5 GB✓ Runs
Mistral Large 2 (MoE)141BINT2~42.3 GB✓ Runs
Qwen 2.5 72B72BFP4~43.2 GB✓ Runs
Llama 3 70B70.6BFP4~42.4 GB✓ Runs
Llama 3.3 70B70.6BFP4~42.4 GB✓ Runs
Llama 3.1 70B70BFP4~42.0 GB✓ Runs
Llama 2 70B70BFP4~42.0 GB✓ Runs
Falcon 40B40BFP8~48.0 GB✓ Runs
Qwen 2.5 32B32BFP8~38.4 GB✓ Runs
Qwen 3 32B32BFP8~38.4 GB✓ Runs
OLMo 3 32B32BFP8~38.4 GB✓ Runs
Gemma 4 31B31BFP8~37.2 GB✓ Runs
Qwen 3 30B-A3B (MoE)30BFP16~72.0 GB✓ Runs
Gemma 3 27B27BFP16~64.8 GB✓ Runs
Phi-414BFP32~67.2 GB✓ Runs
Llama 2 13B13BFP32~62.4 GB✓ Runs
OLMo 2 13B13BFP32~62.4 GB✓ Runs
Mistral Nemo 12B12BFP32~57.6 GB✓ Runs
Gemma 3 12B12BFP32~57.6 GB✓ Runs
Gemma 2 9B9BFP32~43.2 GB✓ Runs
Llama 3 8B8BFP32~38.4 GB✓ Runs
Llama 3.1 8B8BFP32~38.4 GB✓ Runs
Qwen 3 8B8BFP32~38.4 GB✓ Runs
Llama 3.3 8B8BFP32~38.4 GB✓ Runs
Llama 2 7B7BFP32~33.6 GB✓ Runs
Mistral 7B7BFP32~33.6 GB✓ Runs
Qwen 2.5 7B7BFP32~33.6 GB✓ Runs
Falcon 7B7BFP32~33.6 GB✓ Runs
OLMo 2 7B7BFP32~33.6 GB✓ Runs
OLMo-7B7BFP32~33.6 GB✓ Runs
Mistral Small 3 7B7BFP32~33.6 GB✓ Runs
Gemma 3 4B4BFP32~19.2 GB✓ Runs
Phi-33.8BFP32~18.2 GB✓ Runs
Phi-3-mini-128K3.8BFP32~18.2 GB✓ Runs
Llama 3.2 3B3BFP32~14.4 GB✓ Runs
Llama 3.2 1B1BFP32~4.8 GB✓ Runs
Gemma 3 1B1BFP32~4.8 GB✓ Runs

Measured throughput

ModelQuantizationTokens/sec (measured)
DeepSeek-V4-Flash (MoE)Q4_K_M47
Llama 3.2 7BQ4_K_M44
Gemma 3 27BQ4_K_M24
Qwen 3 32BQ4_K_M18
Llama 3.3 70BQ4_K_M14

Similar unified-memory machines

Alternatives with similar memory

See what runs where on popular hardware