# llm_infer_learning

**Repository Path**: linzm1007/llm_infer_learning

## Basic Information

- **Project Name**: llm_infer_learning
- **Description**: About
大模型推理学习，vllm、sglang、nano-vllm学习记录
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2025-12-07
- **Last Updated**: 2025-12-07

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## 1 sglang
### 1.1 sglang框架图
v0.5.5 post3<br>
参考 <br>
https://github.com/zhaochenyang20/Awesome-ML-SYS-Tutorial/blob/main/sglang/code-walk-through/readme-CN.md<br>
https://github.com/sgl-project/sglang/tree/v0.5.5.post3<br>
![sglang框架.png](asset/sglang%E6%A1%86%E6%9E%B6.png)

## 2 vllm 
### 2.1 vllm框架图和pangu7b模型图
v0.9.0<br>
参考 <br>
https://shen-shanshan.github.io/articles/vllm-v1-%E6%95%B4%E4%BD%93%E6%B5%81%E7%A8%8B%E4%BB%8E%E8%AF%B7%E6%B1%82%E5%88%B0%E7%AE%97%E5%AD%90%E6%89%A7%E8%A1%8C/<br>
https://gitee.com/omniai/omniinfer/tree/release_v0.6.0/<br>
https://github.com/vllm-project/vllm/tree/v0.9.0<br>
![vllm框架.png](asset/vllm%E6%A1%86%E6%9E%B6.png)

## 3 nano-vllm
### 3.1 nona-vllm框架图
master 时间20251010
![nona-vllm框架.png](asset/nona-vllm%E6%A1%86%E6%9E%B6.png)
### 3.2 nano-vllm-Qwen3-0.6B模型图
master 时间20251010
![nano-vllm-Qwen3-0.6B.png](asset/nano-vllm-Qwen3-0.6B.png)

## 4 transformers
### 4.1 DeepseekV3模型图
![transformers-DeepseekV3.png](asset/transformers-DeepseekV3.png)
### 4.2 Qwen3-8B模型图
![transformers-Qwen3-8B.png](asset/transformers-Qwen3-8B.png)