Discrete GPU★ Popular pick

NVIDIA RTX 6000 Ada

48 GB$6500~43.2 GB usable

Type: Discrete GPU
Provider: NVIDIA ★
VRAM: 48 GB
Price: $6500

Usable for models (est.): 43.2 GB · Price per GB: $135

Popular models that run here

The largest models this device holds fully in memory, each at its best-fitting quantization.

Every model: does it fit?

36 of 41 models run fully in memory, 2 more with partial offload. Estimated at a 4096-token context. How fit is calculated

Model	Params	Best fit	Memory needed (est.)	Fit
DeepSeek-V4-Pro (MoE)	1600B	—	~480.0 GB	✕ Does not fit
DeepSeek-V3 (MoE)	671B	—	~201.3 GB	✕ Does not fit
Llama 3.1 405B	405B	—	~121.5 GB	✕ Does not fit
DeepSeek-V4-Flash (MoE)	284B	—	~85.2 GB	◐ Partial offload
Qwen 3 235B-A22B (MoE)	235B	—	~70.5 GB	◐ Partial offload
Mistral Large 2 (MoE)	141B	INT2	~42.3 GB	✓ Runs
Qwen 2.5 72B	72B	FP4	~43.2 GB	✓ Runs
Llama 3 70B	70.6B	FP4	~42.4 GB	✓ Runs
Llama 3.3 70B	70.6B	FP4	~42.4 GB	✓ Runs
Llama 3.1 70B	70B	FP4	~42.0 GB	✓ Runs
Llama 2 70B	70B	FP4	~42.0 GB	✓ Runs
Falcon 40B	40B	FP4	~24.0 GB	✓ Runs
Qwen 2.5 32B	32B	FP8	~38.4 GB	✓ Runs
Qwen 3 32B	32B	FP8	~38.4 GB	✓ Runs
OLMo 3 32B	32B	FP8	~38.4 GB	✓ Runs
Gemma 4 31B	31B	FP8	~37.2 GB	✓ Runs
Qwen 3 30B-A3B (MoE)	30B	FP8	~36.0 GB	✓ Runs
Gemma 3 27B	27B	FP8	~32.4 GB	✓ Runs
Phi-4	14B	FP16	~33.6 GB	✓ Runs
Llama 2 13B	13B	FP16	~31.2 GB	✓ Runs
OLMo 2 13B	13B	FP16	~31.2 GB	✓ Runs
Mistral Nemo 12B	12B	FP16	~28.8 GB	✓ Runs
Gemma 3 12B	12B	FP16	~28.8 GB	✓ Runs
Gemma 2 9B	9B	FP32	~43.2 GB	✓ Runs
Llama 3 8B	8B	FP32	~38.4 GB	✓ Runs
Llama 3.1 8B	8B	FP32	~38.4 GB	✓ Runs
Qwen 3 8B	8B	FP32	~38.4 GB	✓ Runs
Llama 3.3 8B	8B	FP32	~38.4 GB	✓ Runs
Llama 2 7B	7B	FP32	~33.6 GB	✓ Runs
Mistral 7B	7B	FP32	~33.6 GB	✓ Runs
Qwen 2.5 7B	7B	FP32	~33.6 GB	✓ Runs
Falcon 7B	7B	FP32	~33.6 GB	✓ Runs
OLMo 2 7B	7B	FP32	~33.6 GB	✓ Runs
OLMo-7B	7B	FP32	~33.6 GB	✓ Runs
Mistral Small 3 7B	7B	FP32	~33.6 GB	✓ Runs
Gemma 3 4B	4B	FP32	~19.2 GB	✓ Runs
Phi-3	3.8B	FP32	~18.2 GB	✓ Runs
Phi-3-mini-128K	3.8B	FP32	~18.2 GB	✓ Runs
Llama 3.2 3B	3B	FP32	~14.4 GB	✓ Runs
Llama 3.2 1B	1B	FP32	~4.8 GB	✓ Runs
Gemma 3 1B	1B	FP32	~4.8 GB	✓ Runs

Measured throughput

No one has submitted a measured benchmark for this device yet. The fit list above is an estimate.

Similar GPUs

Alternatives with similar memory

See what runs where on popular hardware