Commit Graph

12 Commits

Author SHA1 Message Date
屈轩
2a9be258f9 fix(mcp-server): mcp use climc struct (#25174) 2026-07-20 17:17:20 +08:00
cwz_eikoh
20620bb5a1 feat(llm): support llm-bench in llm (#25103) 2026-07-15 15:00:37 +08:00
Zexi Li
9cc4d76a81 feat(llm): add ModelScope instant model import and refactor model download (#25092)
Add ModelScope hub integration, download driver, and instant model import
flow parallel to HuggingFace. Extract shared HuggingFace download helpers
and reuse them across vLLM/SGLang container drivers.
2026-07-01 20:13:17 +08:00
Zexi Li
3ff72d8a38 feat(llm): add community images catalog API (#25032)
Expose llmimages.yaml as list/show/refresh endpoints with configurable
source URL, periodic cache refresh, and mcclient module support.
2026-06-15 17:26:37 +08:00
Zexi Li
9d85cfcd5d fix(llm): 更新 model catalog 默认 URL 与 webtop 镜像同步 (#24974)
将 ModelCatalogURL 默认路径改为 model-catalog.yaml;
sync_llm_images 改为同步 fedora-xfce webtop 并注释其它候选镜像。
2026-06-04 18:51:20 +08:00
Zexi Li
be90e452dc feat(llm): llm deployemnt (#24848) 2026-05-20 11:06:23 +08:00
Zexi Li
6dbc39b04f feat(llm): restart action (#24427) 2026-03-11 19:08:28 +08:00
cwz_eikoh
e254c2ccf5 Fix(llm): fix bugs & apikey encrypt & support history for mcp-agent-chat & delete modelname in llmSku (#24149)
* fix(llm): mcp-agent apiKey encrypt

* fix(llm): error-handle when instant-model import

* feature(llm): add get-available-network for llm

* feature(llm): support history for mcp-agent-chat

* fix(llm): llm create with net instead of networktype & networkid

* fix(llm): delete modelName in llmSku & fix some bugs
2026-01-29 10:50:00 +08:00
cwz_eikoh
e9382c9ae7 feature(llm): add mcp-agent (#24025)
* feature(llm): add mcp-agent

* feature(llm): support openai in llm_client

* feature(llm): chat-stream demo
2026-01-12 10:45:53 +08:00
cwz_eikoh
805b8afe9d feature(llm): add llm-instant-model-import (#23928)
* feature(llm): add llm-instant-model-import

* fix(llm): can't delete llm while deploy faile

* feature(llm): add instant-model-import to instant-model-create
2025-12-17 13:33:57 +08:00
cwz_eikoh
142e540f7f [Feature] llm model 使用 post_overlay 功能实现秒装挂载模型 (#23769)
* feat(llm): add probed-package

* feat(llm): add llm-save-instant-app

* feat(llm): add some llm-instant-app options

* fix(llm): change app to model

* fix(llm): rename origin model to sku

* feat(llm): add llm-quick-models

* fix(llm): saved paths for instant model

* fix(llm): fix quick-install-model

---------

Co-authored-by: Zexi Li <zexi.li@icloud.com>
2025-12-03 16:27:10 +08:00
cwz_eikoh
897a6fc61f [OSPP]feature: Auto deploy llm and dify (#23282)
* feat(llm): add llm-create

* fix(llm): fix llm-create, add llm-list & llm-show

* fix(llm): format file names

* fear(llm): add exec stream

* fear(llm): init llm model cache

* fix(llm): move llm model cache to LocalImageCache

* feat(llm): auto clean model cache

* fix(llm): auto clean tmp model cache

* feat(dify): init dify-create

* fix(dify): change dify default registry

* feat: support create model with gguf file

* feat(llm): support more modelfile option for gguf file

* feat(dify): init user customize dify parameters

* feat: update llm as a service in climc

* fix: delete llm from region service

* feat: init llm service (with error)

* fix: resolve errors (task cant callback yet)

* feat: add PerformRequestHostActionByOtherService for container

* fix: make llm service usable

* feat: delete llm and dify after guest deleted

* feat(llm): add llm-image

* feat(llm): add llm-model

* feat: mv old llm to ollama

* feat(llm): init llm-batch-create(can not run)

* fix(llm): make llm-create usable

* fix(llm): add pull-model step

* feat(llm): add list and delete

* fix(llm): ollama pull official model don't rely on host & region's code any more

* feat(llm): add dify-model

* fix: remove llm's code in host & compute

* fix: remove remain code in compute

* feat(llm): Abstract out and reuse the llm_model logic

* feat(llm): abstract llm_base from llm

* fix(llm): make dify usable

* feat(llm): add sync_dify_images.sh

* fix(llm): format import

* feat(llm): support start & stop for llm and dify

* feat(llm): add model-update

* fix(llm): gendocgo
2025-10-24 13:29:31 +08:00