Back to Hardware
Mac Mini M4

Unified memory★ Popular pick

Mac Mini M4

16 GB$599~12.0 GB usable

Type
Unified memory (SoC)
Provider
Apple ★
Unified memory
16 GB
Price
$599

Usable for models (est.): 12.0 GB · Price per GB: $37

Popular models that run here

The largest models this device holds fully in memory, each at its best-fitting quantization.

Every model: does it fit?

30 of 41 models run fully in memory, 5 more with partial offload. Estimated at a 4096-token context. How fit is calculated

ModelParamsBest fitMemory needed (est.)Fit
DeepSeek-V4-Pro (MoE)1600B—~480.0 GB✕ Does not fit
DeepSeek-V3 (MoE)671B—~201.3 GB✕ Does not fit
Llama 3.1 405B405B—~121.5 GB✕ Does not fit
DeepSeek-V4-Flash (MoE)284B—~85.2 GB✕ Does not fit
Qwen 3 235B-A22B (MoE)235B—~70.5 GB✕ Does not fit
Mistral Large 2 (MoE)141B—~42.3 GB✕ Does not fit
Qwen 2.5 72B72B—~21.6 GB◐ Partial offload
Llama 3 70B70.6B—~21.2 GB◐ Partial offload
Llama 3.3 70B70.6B—~21.2 GB◐ Partial offload
Llama 3.1 70B70B—~21.0 GB◐ Partial offload
Llama 2 70B70B—~21.0 GB◐ Partial offload
Falcon 40B40BINT2~12.0 GB✓ Runs
Qwen 2.5 32B32BINT2~9.6 GB✓ Runs
Qwen 3 32B32BINT2~9.6 GB✓ Runs
OLMo 3 32B32BINT2~9.6 GB✓ Runs
Gemma 4 31B31BINT2~9.3 GB✓ Runs
Qwen 3 30B-A3B (MoE)30BINT2~9.0 GB✓ Runs
Gemma 3 27B27BINT2~8.1 GB✓ Runs
Phi-414BFP4~8.4 GB✓ Runs
Llama 2 13B13BFP4~7.8 GB✓ Runs
OLMo 2 13B13BFP4~7.8 GB✓ Runs
Mistral Nemo 12B12BFP4~7.2 GB✓ Runs
Gemma 3 12B12BFP4~7.2 GB✓ Runs
Gemma 2 9B9BFP8~10.8 GB✓ Runs
Llama 3 8B8BFP8~9.6 GB✓ Runs
Llama 3.1 8B8BFP8~9.6 GB✓ Runs
Qwen 3 8B8BFP8~9.6 GB✓ Runs
Llama 3.3 8B8BFP8~9.6 GB✓ Runs
Llama 2 7B7BFP8~8.4 GB✓ Runs
Mistral 7B7BFP8~8.4 GB✓ Runs
Qwen 2.5 7B7BFP8~8.4 GB✓ Runs
Falcon 7B7BFP8~8.4 GB✓ Runs
OLMo 2 7B7BFP8~8.4 GB✓ Runs
OLMo-7B7BFP8~8.4 GB✓ Runs
Mistral Small 3 7B7BFP8~8.4 GB✓ Runs
Gemma 3 4B4BFP16~9.6 GB✓ Runs
Phi-33.8BFP16~9.1 GB✓ Runs
Phi-3-mini-128K3.8BFP16~9.1 GB✓ Runs
Llama 3.2 3B3BFP16~7.2 GB✓ Runs
Llama 3.2 1B1BFP32~4.8 GB✓ Runs
Gemma 3 1B1BFP32~4.8 GB✓ Runs

Measured throughput

ModelQuantizationTokens/sec (measured)
Llama 3.2 7BQ4_K_M22

Similar unified-memory machines

Alternatives with similar memory

See what runs where on popular hardware