Document Gradio device selection

This commit is contained in:
muyleanging
2026-05-18 17:06:11 +09:00
parent 36a1378e53
commit e08754bcc0
2 changed files with 16 additions and 0 deletions

View File

@@ -242,6 +242,14 @@ voxcpm --help
python app.py --port 8808 # then open in browser: http://localhost:8808
```
Use `--device` to choose the runtime device:
```bash
python app.py --device auto
```
Supported values are `auto`, `cpu`, `mps`, `cuda`, and `cuda:N`. On Apple Silicon Macs, `auto` uses MPS when available.
### 🚢 Production Deployment (Nano-vLLM)
For high-throughput serving, use [**Nano-vLLM-VoxCPM**](https://github.com/a710128/nanovllm-voxcpm) — a dedicated inference engine built on Nano-vLLM with concurrent request support and an async API.

View File

@@ -241,6 +241,14 @@ voxcpm --help
python app.py --port 8808 # 然后在浏览器打开 http://localhost:8808
```
使用 `--device` 选择运行设备:
```bash
python app.py --device auto
```
支持的取值包括 `auto``cpu``mps``cuda``cuda:N`。在 Apple Silicon Mac 上,`auto` 会在可用时使用 MPS。
### 🚢 生产部署Nano-vLLM
如需高吞吐量部署,使用 [**Nano-vLLM-VoxCPM**](https://github.com/a710128/nanovllm-voxcpm) — 基于 Nano-vLLM 构建的专用推理引擎,支持并发请求和异步 API。