@dwade-wang
WangChunyang 暂无简介
MindSpore的vLLM插件,支持基于vLLM框架部署MindSpore模型的推理服务。
vLLM is a fast and easy-to-use library for LLM inference and serving.
A solution for large model inference, such as DeepSeek, built with full-stack open-source components.