Why the Chip Is Built to Run Models, Not Train Them
The most important detail in the Reuters report is also the easiest to miss: DeepSeek's chip is designed for inference, not training [1]. Training a model happens once and is dominated by Nvidia's GPUs and the CUDA software stack. Inference - the work of generating a response every time someone sends a prompt - happens forever. It is what SiliconANGLE calls the recurring cost center that drives revenue once people actually start using a model [2]. Whoever controls the inference chip controls the unit economics of an AI business.
That is why a narrower, purpose-built chip can win here. A custom inference chip, essentially an application-specific circuit that does one job rather than everything, can cut power draw and per-token serving cost relative to a general-purpose GPU. The tradeoff is flexibility, but a lab serving mainly its own models does not need much flexibility. DeepSeek is not chasing Nvidia on training; it is trying to own the cheaper, repeatable half of the compute stack - the same logic behind OpenAI's Broadcom-co-designed Jalapeno inference chip [2].



