# DeepSeek open-sources inference framework with support for Nvidia and Huawei chips — retained record

> Retained china-news record from china-news:technode.

Canonical: https://highsignal.app/data/records/d8c41cbc86e27f7c

[← sources](https://highsignal.app/data)


source: [china-news](https://highsignal.app/data/china-news) (china-news:technode)  published 2026-10-21 07:46 ingested 2026-10-22 02:56

[original source ↗](https://technode.com/2026/10/21/deepseek-open-sources-inference-framework-with-support-for-nvidia-and-huawei-chips/)

## retained text



```
DeepSeek released DeepInfer, the inference framework behind its large-scale model services, on October 20. The framework supports Nvidia GPUs and Huawei Ascend processors and provides capabilities including distributed inference, speculative decoding and structured output. DeepSeek said the release is intended to help developers and businesses improve throughput and latency while reducing computing costs and energy consumption.
The company also open-sourced deepseek-recipe, a component that converts API requests and handles model input and output processing in line with DeepSeek’s own service. DeepInfer currently supports DeepSeek-V4.1-Flash-1017, and the company plans to continue releasing inference code and optimizations for future models through the project. [DeepSeek]
```



document fetched 2026-10-24 02:53 · canonical https://technode.com/2026/10/21/deepseek-open-sources-inference-framework-with-support-for-nvidia-and-huawei-chips
