fanhuadesenlinnn/cloudpods
1
0
Fork 0
mirror of https://hubproxy.babadafafafafa.cn/https://github.com/yunionio/cloudpods.git synced 2026-09-20 16:13:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,957 Commits 27 Branches 687 Tags
8d0ee46764fe421bbcb87cec4fadfb1d594cb172
Commit Graph

73 Commits

Author SHA1 Message Date
屈轩
29a2eca906 fix(mcp-server): optimized mcp desc (#25193) 2026-07-21 16:19:09 +08:00
屈轩
2a9be258f9 fix(mcp-server): mcp use climc struct (#25174) 2026-07-20 17:17:20 +08:00
wanyaoqi
76f035e4e3 feat(region,host,scheduler): isolated device refactor and hami support (#25182) 2026-07-20 14:00:04 +08:00
Zexi Li
49c5cfa421 feat(aiproxy): auto-provision placeholder ai_key for upstream resolve (#25156) 2026-07-15 19:24:57 +08:00
cwz_eikoh
ed4a8dc049 feat(llm): add llm-router-agent (#25128) 2026-07-15 15:31:08 +08:00
cwz_eikoh
20620bb5a1 feat(llm): support llm-bench in llm (#25103) 2026-07-15 15:00:37 +08:00
Zexi Li
afde072512 feat(aiproxy): add OpenAI Responses API with provider adapters and Codex support (#25127) 
Implement /v1/responses endpoint with multi-provider translation (OpenAI, Azure,
Anthropic, Gemini), streaming compat layers, Codex config/tool integration, and
updated functional test docs.
 2026-07-10 16:40:56 +08:00
Zexi Li
167682c39b feat(aiproxy): add Anthropic Messages API and migrate functional tests to Go (#25107) 
Add /v1/messages handler with Anthropic-to-OpenAI translation, upstream
failover, and probe endpoints. Replace shell-based functional test scripts
with pkg/aiproxy/ft and climc test commands; consolidate documentation.
 2026-07-07 20:13:14 +08:00
Zexi Li
9cc4d76a81 feat(llm): add ModelScope instant model import and refactor model download (#25092) 
Add ModelScope hub integration, download driver, and instant model import
flow parallel to HuggingFace. Extract shared HuggingFace download helpers
and reuse them across vLLM/SGLang container drivers.
 2026-07-01 20:13:17 +08:00
Zexi Li
3431c10196 feat(llm): support local_path scheduling with prefer_hosts and deployment restart (#25090) 2026-07-01 13:11:19 +08:00
Zexi Li
d9cf601841 feat(llm): backfill orphan LLM instances into deployments on init (#25081) 
On service startup, find LLM instances without llm_deployment_id and
create a matching SLLMDeployment, then link the instance. Idempotent
across restarts; skipped on slave nodes.
 2026-06-29 11:28:54 +08:00
cwz_eikoh
b48c1be667 feat(llm): tool call defaults & auto gpu ultilization (#25074) 
* feat(llm): upgrade auto-gpu-ultilization

* feat(llm): add vllm tool call defaults

* feat(llm): add sglang tool call defaults
 2026-06-26 10:15:19 +08:00
Zexi Li
8f1d740b54 feat(llm): async instant model delete and improve import status tracking (#25073) 
fix(aiproxy): set OpenAI handler process timeouts and skip upstream error
response when request context is already cancelled.
 2026-06-25 19:52:46 +08:00
Zexi Li
ba39e80fd8 feat(llm): validate GPU devices on deployment create and improve error messages (#25063) 2026-06-24 14:27:25 +08:00
cwz_eikoh
d4dd65cb24 Feature/http get+llm probe (#25016) 
* hostman: probe http get in pod netns

* llm: watch pod status for service readiness
 2026-06-23 19:40:30 +08:00
Zexi Li
4a4b3f8676 feat(llm): sync llm deployment with aiproxy catalog and routing (#25057) 
Add auto_register_aiproxy on llm_deployment creation, background sync task,
and register/unregister CLI actions. Link aiproxy providers, routings, and
models to llm replicas via llm_id and llm_deployment_id fields.
 2026-06-22 20:14:01 +08:00
cwz_eikoh
108db8ca87 Feature/llm route for aiproxy (#25044) 
* feat(aiproxy): support routing model in aiproxy

* feat(llm): add llm-router
 2026-06-22 10:09:38 +08:00
Zexi Li
3ff72d8a38 feat(llm): add community images catalog API (#25032) 
Expose llmimages.yaml as list/show/refresh endpoints with configurable
source URL, periodic cache refresh, and mcclient module support.
 2026-06-15 17:26:37 +08:00
屈轩
7c7353cf7b feat(aiproxy): add aiproxy (#24916) 2026-06-09 18:54:42 +08:00
cwz_eikoh
bf8aab9f75 Feat/deployment hostpath (#24985) 
* feat(llm): hostpath support in deployment

* fix(llm): status error in deployment & sku deleted by deployment accidentally
 2026-06-08 11:23:34 +08:00
Zexi Li
9d85cfcd5d fix(llm): 更新 model catalog 默认 URL 与 webtop 镜像同步 (#24974) 
将 ModelCatalogURL 默认路径改为 model-catalog.yaml；
sync_llm_images 改为同步 fedora-xfce webtop 并注释其它候选镜像。
 2026-06-04 18:51:20 +08:00
Zexi Li
dd719de15c fix(llm): container desktop (#24969) 2026-06-04 11:51:29 +08:00
Zexi Li
df815ad02b feat(llm): container desktop (#24960) 2026-06-03 13:24:39 +08:00
cwz_eikoh
8a676e6b4c Feat/auto gpu ultilization (#24924) 
* fix(llm): support hf import llm_sku

* feat(llm): auto-gpu-memory-utilization
 2026-05-29 17:45:35 +08:00
cwz_eikoh
76e30df4f5 Feature/download progress (#24885) 
* feat(llm): support download progress when model import

* fix(llm): unsupported catalog source \"ollama\" when model_set import llm_sku
 2026-05-27 13:20:47 +08:00
Zexi Li
9ce9949b21 feat(llm,scheduler): vram calculation (#24889) 2026-05-25 16:27:28 +08:00
cwz_eikoh
588c38ec74 feat(llm): auto append backend_parameters in vllm & sglang (#24876) 2026-05-22 17:01:54 +08:00
cwz_eikoh
b0cf03c486 feat(hermes): connect vllm/sglang/ollama (#24842) 
Co-authored-by: Zexi Li <zexi.li@icloud.com>
 2026-05-21 11:41:01 +08:00
cwz_eikoh
ff6d21e6ca feat(llm): create llm_sku from llm_model_set (#24855) 2026-05-21 11:40:23 +08:00
cwz_eikoh
f8ee734d8f feat(llm): Implement resumable downloads for models from Hugging Face (#24843) 2026-05-21 10:48:27 +08:00
Zexi Li
be90e452dc feat(llm): llm deployemnt (#24848) 2026-05-20 11:06:23 +08:00
Zexi Li
83d434bceb fix(llm): persistent /config dir of hermes agent (#24835) 2026-05-18 14:57:39 +08:00
cwz_eikoh
211619b685 feat(llm): support sglang (#24820) 2026-05-14 16:47:01 +08:00
cwz_eikoh
aec0118414 Feature(vllm): use entrypint instead of StartLLM (#24801) 
* feat(llm): use entrypoint instead of StartLLM

* feat(llm): adapt front-end in comfyui instant-model
 2026-05-12 10:43:05 +08:00
Zexi Li
6c4d68f3b8 fix(llm): honor SLLM device override when building container spec (#24799) 2026-05-11 20:06:35 +08:00
Zexi Li
b2ec881a68 feat(llm): add SLLM mounted_models override and driver-level validation (#24797) 2026-05-11 17:41:28 +08:00
cwz_eikoh
a0a34f27f6 Feature/comfyui instant model (#24760) 
* feat(llm): support cursor

* feat(llm): support import from huggingface

* fix(llm): direction error

* feat(llm): support instant model for comfyui

* feat(llm): support multi file select when save-instant-model
 2026-05-07 14:42:44 +08:00
wanyaoqi
cc8cb4dbdf fix(mcclient,region): add tasks mod, service app options (#24731) 2026-04-29 23:47:54 +08:00
Zexi Li
88caf1cd2b fix(host,llm): fix pod shm mount path return and llm restart memory config (#24738) 
- Return shmPath instead of empty string when mountpoint is already
  mounted, so callers get the correct path
- Remove incorrect +1 offset in memory comparison and size formatting
  during LLM restart config change
 2026-04-28 19:57:48 +08:00
Zexi Li
0c6a3770b5 feat(llm): support OpenClaw manual config mode (#24720) 
When ManualConfig is enabled, inject OPENCLAW_MANUAL_CONFIG=1 env var
and skip provider/channel credential injection, allowing users to
configure providers and channels themselves inside the desktop.
 2026-04-24 11:45:53 +08:00
cwz_eikoh
65e1160c00 Feature/hf-search (#24717) 
* llm: add instant-model huggingface query commands

* fix(vllm): use ping instead of health
 2026-04-24 10:28:13 +08:00
Zexi Li
b61af890d1 refactor(llm): extract shared desktop webtop config (#24701) 
Move common desktop/webtop container envs, base spec, rootfs, and login-info parsing
into llm_container helpers and reuse in openclaw and hermes-agent drivers.
 2026-04-21 15:04:54 +08:00
Zexi Li
54f4b36e05 feat(llm): support hermes-agent (#24697) 2026-04-20 12:47:30 +08:00
cwz_eikoh
ff89a3839b feat(llm): add hostpaths for llm-sku (#24693) 2026-04-20 10:51:16 +08:00
Zexi Li
fc6079ed86 fix(llm): harden volume resize and update size log (#24670) 
- Wait for disk/desktop status after resize via backup worker
- Centralize volume SizeMB update with resize action log
- Expose vCPU/memory fields in LLM customize columns
 2026-04-13 14:39:02 +08:00
cwz_eikoh
f73e975920 feat(llm): get available models from base_url (for ollama & openai) (#24605) 2026-04-01 15:44:11 +08:00
Zexi Li
7756be9d38 fix(llm): 修复 llm 镜像没有根据 sku 更新的问题 (#24574) 2026-03-26 21:46:00 +08:00
cwz_eikoh
7598268cd5 fix(vllm): user customize args & health check in hostlocal net (#24543) 2026-03-25 10:36:21 +08:00
Zexi Li
e25d6eb814 feat(llm): unify container access url info and login response (#24505) 2026-03-19 23:06:44 +08:00
cwz_eikoh
bdc211a779 feat(llm): support model import for vllm (#24499) 2026-03-19 15:03:35 +08:00