malaysia-ai/GH200-ARM64-vLLM-wheel

---
viewer: false
---

# GH200 ARM64 vLLM wheel

We build wheels for GH200 ARM64 from [Lambda AI](https://lambda.ai/) for specific PyTorch version,

1. `torch==2.7.1+cu128`
2. `torchaudio==2.7.1`
3. `torchvision==0.22.1`

Full requirements in [requirements.txt](requirements.txt), but PyTorch 2.7.1 Cuda 12.8 should be enough,

```bash
pip3 install torch==2.7.1 torchvision==0.22.1 torchaudio==2.7.1 pytorch-triton==3.3.0 --index-url https://download.pytorch.org/whl/cu128
```

## Build by yourself

Step to reproduce at [build.sh](build.sh).

---
查看器：禁用
---

# GH200 ARM64 架构vLLM Python Wheel安装包

我们由[Lambda AI](https://lambda.ai/)针对特定PyTorch版本，为GH200 ARM64架构构建vLLM的Python Wheel安装包，适配的依赖版本如下：
1. `torch==2.7.1+cu128`
2. `torchaudio==2.7.1`
3. `torchvision==0.22.1`

完整依赖项可查阅[requirements.txt](requirements.txt)，但仅需PyTorch 2.7.1搭配CUDA 12.8即可满足安装需求，可通过以下命令完成依赖安装：
bash
pip3 install torch==2.7.1 torchvision==0.22.1 torchaudio==2.7.1 pytorch-triton==3.3.0 --index-url https://download.pytorch.org/whl/cu128

## 自行构建

可通过[build.sh](build.sh)中的步骤复现完整构建流程。