Guides
Short reads for when the numbers are not enough. Start with the Quickstart grid if you're new.
- Quickstart: what runs whereOne grid of popular models against popular machines. Green runs, red doesn't, so you can see where the frontier sits.
- Mac or dedicated GPU?Unified memory versus VRAM: what each buys you in model size, speed, and price per GB.
- Quantization, in plain wordsWhat FP16, Q8_0, and Q4_K_M mean, and which one you should actually download.
- How much memory do I need?A quick rule of thumb for turning a parameter count into the GB you need.