Open-source plugin lets AI models run on Huawei chips — 2,200 GitHub stars in 16 months
vLLM-Ascend is an open-source plugin that makes it possible to run AI models on Huawei's Ascend chips instead of Nvidia GPUs. This gives developers and companies a new hardware option that could cut costs and reduce reliance on a single supplier. It reached 2,200 GitHub stars in just 16 months, showing steady community interest.
Right now, running large AI models almost always requires Nvidia GPUs, which are expensive and, for some countries and companies, hard to obtain due to US export controls. vLLM-Ascend plugs into vLLM — a popular engine for running AI models — and adds support for Huawei's Ascend chips, so the same AI models can run on different hardware without rewriting everything from scratch.
The practical upside is reduced hardware lock-in. If Nvidia chips become scarce or too costly, having a working alternative lowers risk and could bring down data center bills. Because it is open source, anyone can inspect the code, use it for free, or contribute improvements.
Key points
- vLLM-Ascend lets you run AI models on Huawei Ascend chips, not just Nvidia GPUs
- It works as a drop-in plugin for vLLM, so existing setups need minimal changes
- Offers a real alternative for organizations blocked from or priced out of Nvidia hardware
- 2,200 GitHub stars in 16 months signals active community adoption
- Free to use and modify as open-source software
Quick term guide
- open-source
- Software whose code is shared publicly so others can inspect, use, or change it.
- AI models
- The core brain or underlying program that powers an artificial intelligence tool.
- AI model
- A program that can understand prompts and produce text, code, or answers.
- Ascend chips
- AI processing chips made by Huawei, designed to compete with Nvidia GPUs.
- developers
- Developers are people who build software, apps, or websites.
- data center
- A large facility full of servers that runs internet services and AI computations
- open source
- Software whose code is available for people to view and often modify.
- open-source software
- Software that is free for anyone to use, view, and change.