DeepSeek-V3.2 Hardware Requirements: Can You Run It Locally?

DeepSeek-V3.2 Hardware Requirements: Can You Run It Locally?

DeepSeek-V3.2 is a 685-billion-parameter MoE model (MIT) with a 128k context. Because it is a Mixture-of-Experts model, only about 37 B of its parameters are active per token, so it generates faster than its full size suggests, but you still have to fit the whole thing in memory. A 685B Mixture-of-Experts model with about 37B active parameters and DeepSeek Sparse Attention for efficient long context; prior generation. It is a frontier-scale model, which makes the local question blunt: for almost everyone, you do not run this on your own hardware. Here is exactly why, and the cheaper path.

The short answer

Only the largest machines we track can hold DeepSeek-V3.2, and only at a heavy quant. Here are the ones that fit: For a model this size, renting a cloud GPU or using a hosted API is almost always the saner option.

MachineMemoryQuantWeights~tok/s
Mac Studio, 512GB unified (Ultra)512 GB (unified)Q5_K_M~488.1 GB~26 tok/s

The memory math

Weights scale with parameters. At Q4_K_M (about 4.8 bits) DeepSeek-V3.2 is roughly 411 GB of weights; squeezed to a low-quality Q2 it is still about 287 GB, before you add the KV cache and overhead. That puts it in a multi-GPU server or two 512 GB Mac Studios territory, not consumer hardware. The VRAM guide and the quantization guide walk through the trade-offs, and why a Mixture-of-Experts model is cheaper to serve than its size implies.

Or just rent it (the realistic option)

At this scale, renting a GPU by the hour or calling a hosted API almost always beats buying. Our cost calculator does the buy-versus-rent-versus-API math for your actual usage, so you can see the break-even instead of guessing. One upside of its Mixture-of-Experts design: hosts can serve it more cheaply than a dense model its size, so API pricing is often reasonable.

Check the details

Sources and method

  • Memory requirements computed from the model's parameter count and standard quant bit-rates with the same engine as our calculator.
  • A fit-and-feasibility reference, not first-hand testing by Vetted Consumer. Verify the model's exact parameter and active-parameter counts on its model card before relying on the numbers.

Get the Vetted Consumer newsletter

Reviews, buying advice, and field notes. Delivered monthly.

Almost there, check your inbox and click the confirmation link. ✓

Something went wrong, please try again, or email [email protected].