Inference Ate the AI Trade
The number that matters in SambaNova's round is not the billion dollars - it is what investors are now willing to pay for a chip company that never claimed to win at training. For two years the AI hardware story was about who could train the biggest model, and that market belonged almost entirely to Nvidia. SambaNova is betting on the other half of the AI lifecycle: inference, the part where a trained model actually answers your questions, and where the same query runs millions of times a day. As AI spend shifts from a one-time training cost to a permanent, recurring cost of running models, the price of inference starts to decide whether an AI product is profitable at all [3].
That shift is what makes a non-Nvidia inference vendor investable. Liang frames it bluntly, arguing the race is no longer about building the biggest model but about who can "light up entire data centers with AI agents that answer instantly, never stall, and do it at a cost that turns AI from an experiment into the most profitable engine in the cloud" [2]. In other words, the buyer's question has changed from "whose model is smartest" to "whose infrastructure serves it cheapest per token," and that is a question where a purpose-built inference chip can compete without ever beating Nvidia at training. The $11B price tag is the market putting a number on that thesis.



