The Architecture Behind the Price Cut
DeepSeek's headline this week wasn't just a benchmark score - it was an architecture decision that makes long-context inference cheap enough to give away. The hybrid attention design combining Compressed Sparse Attention and Heavily Compressed Attention means that, at the 1-million-token context setting, V4 Pro needs only 27% of the single-token inference FLOPs and 10% of the KV cache that DeepSeek-V3.2 required [1]. Under the hood, that's a 1.6-trillion-parameter Mixture-of-Experts model that only activates 49 billion parameters per token, trained on more than 32 trillion tokens and released open-weight under an MIT license [2]. Greyhound Research analyst Sanchit Vir Gogia reads this as a deliberate design choice rather than a side effect: V4 Pro "was engineered to cut the cost of long-context inference, running at roughly a quarter of the single-token compute and a tenth of the memory footprint of its predecessor" [3]. That efficiency is exactly why builders testing the model through coding-agent harnesses this week were reporting real end-to-end tasks completed for pennies rather than dollars - the architecture, not just the discount, is doing the work.




