DeepSeek open-sources DeepInfer after US federal ban on DeepSeek products

Most 'open AI' announcements mean a company published model weights. DeepSeek did something rarer: it released DeepInfer, the actual production software stack that serves live traffic for DeepSeek-V4.1-Flash ^[1]. The project's own documentation describes it as the framework that 'powers DeepSeek's large-scale production services' ^[2], and the numbers behind that claim explain why competitors are paying attention - one production cluster reportedly handles 155 trillion tokens a day, with off-peak pricing working out to about $38 per GPU per hour and speculative decoding adding a 4-7% throughput gain at production load ^[1]. vLLM, the open-source project DeepInfer was originally built on top of, publicly thanked DeepSeek for crediting the community and said it plans to fold DeepInfer's techniques back into its own codebase, which suggests this release is already feeding back into shared inference tooling rather than sitting as a one-off announcement. The reaction on Reddit leaned toward disbelief that a frontier lab would give away its cost advantage for free, with threads comparing the move favorably against what Anthropic, OpenAI, or Meta would do - the underlying argument being that weights alone don't make a model cheap to run; the serving stack is where the real engineering and margin sit.

The federal ban did not become public the moment it was signed. DHS Secretary Markwayne Mullin signed the directive on July 24, 2026 under the Federal Acquisition Supply Chain Security Act of 2018 ^[3], but it only became public through an October 20 Federal Register filing covering roughly 430 federal civilian departments, bureaus, and agencies ^[4]. Those agencies now have 60 days to purge DeepSeek-derived software from their systems and to request exceptions ^[3][4]. DHS's stated justification rested on three points: DeepSeek storing user data on servers in China, an account-creation flow that collects personally identifiable information and can track or fingerprint users, and independently documented vulnerabilities in DeepSeek's iOS app ^[3][4]. DeepInfer went open source the very next day ^[1], a sequence multiple outlets explicitly framed as connected to the ban ^[5], though neither DeepSeek's own announcement nor the reporting available confirms the release was a direct reaction. On Reddit, one commenter in r/singularity asked outright whether the release had anything to do with the US government's removal order - a question that captures how directly the two events are being read together.

DeepInfer doesn't just run on Nvidia hardware. It supports Nvidia's SM100 Blackwell GPUs and Huawei's Ascend 950 neural processing units, while explicitly excluding Hopper and other older Nvidia architectures ^[1]. That detail is being read as a notable production endorsement of Huawei's chips from a frontier AI lab ^[6], a meaningful data point in the broader contest over whether non-Nvidia AI chips can handle real workloads. It's also a hedge: the ban itself only restricts US government procurement and doesn't touch Nvidia's technical cooperation with DeepSeek ^[1], but by building production support for Chinese-made chips directly into its flagship open-source release, DeepSeek reduces its own exposure to any future hardware-side restriction. One independent commentator on X flagged the same detail as noteworthy: the framework "runs on Huawei chips, not just Nvidia." Reddit's more technical threads added a practical data point in the same vein: DeepSeek-V4.1-Flash, at roughly 380GB in nvfp4 precision, can run on six RTX 6000 Pro GPUs, though KV cache management - a piece of the serving pipeline - is explicitly not included in what was open-sourced.

China's government wasted no time condemning the ban. Its Commerce Ministry called the move discriminatory, accused Washington of using national security 'as a cover for suppression,' and said China would take 'necessary measures' to protect its companies' interests ^[7]. But the protest sits awkwardly next to China's own policy: reporting on the episode notes that China blocks ChatGPT, Claude, and Gemini domestically even as it objects to the US restricting DeepSeek ^[8]. The practical effect of the US order is also narrower than the rhetoric suggests - it applies only to federal civilian government systems, not to private companies or consumers, who remain free to use DeepSeek's products, including the newly open-sourced DeepInfer ^[9]. Reddit's discussion surfaced a second layer of the same contradiction: a side-thread debated China's own new export rules restricting frontier models from leaving the country, with commenters disagreeing over whether DeepSeek-V4.1-Flash would even count as exempt as a smaller, non-frontier model - a sign that the 'open China' framing may not extend cleanly to DeepSeek's most capable systems.