diff --git a/README.md b/README.md index cea9b3c..dc1a544 100644 --- a/README.md +++ b/README.md @@ -242,6 +242,14 @@ voxcpm --help python app.py --port 8808 # then open in browser: http://localhost:8808 ``` +Use `--device` to choose the runtime device: + +```bash +python app.py --device auto +``` + +Supported values are `auto`, `cpu`, `mps`, `cuda`, and `cuda:N`. On Apple Silicon Macs, `auto` uses MPS when available. + ### 🚢 Production Deployment (Nano-vLLM) For high-throughput serving, use [**Nano-vLLM-VoxCPM**](https://github.com/a710128/nanovllm-voxcpm) — a dedicated inference engine built on Nano-vLLM with concurrent request support and an async API. diff --git a/README_zh.md b/README_zh.md index 497554d..ec781e4 100644 --- a/README_zh.md +++ b/README_zh.md @@ -241,6 +241,14 @@ voxcpm --help python app.py --port 8808 # 然后在浏览器打开 http://localhost:8808 ``` +使用 `--device` 选择运行设备: + +```bash +python app.py --device auto +``` + +支持的取值包括 `auto`、`cpu`、`mps`、`cuda` 和 `cuda:N`。在 Apple Silicon Mac 上,`auto` 会在可用时使用 MPS。 + ### 🚢 生产部署(Nano-vLLM) 如需高吞吐量部署,使用 [**Nano-vLLM-VoxCPM**](https://github.com/a710128/nanovllm-voxcpm) — 基于 Nano-vLLM 构建的专用推理引擎,支持并发请求和异步 API。