Update model configurations and enhance LLM runtime logic

- Revised model URLs and descriptions in `llamacpp-models.example.yaml` and `ollama-models.example.yaml` to reflect new recommendations and vision capabilities.
- Updated the LLM runtime logic to support vision projectors and improved model resolution handling.
- Enhanced the installation script to conditionally include vision projectors when available.
- Added tests to validate the inclusion of vision projectors in model presets and ensure proper URL remapping for deprecated models.
- Improved documentation to clarify model usage and configuration options.
This commit is contained in:
Leonid Pershin
2026-08-21 07:40:47 +03:00
parent 618e6e4806
commit 15b95f04c7
7 changed files with 161 additions and 54 deletions
+8 -8
View File
@@ -1,17 +1,17 @@
# Copy to ollama-models.yaml (gitignored). Used when LLM_RUNTIME=ollama.
# name = exact tag for `ollama pull`. Empty models: [] → runtime only, no pull.
# Purpose: help craft SwarmUI prompts (RU/EN, low refusal).
# Purpose: SwarmUI prompt help + vision (RU/EN, low refusal).
models:
# Recommended: Russian+English, ~5GB, low refusal (community abliterate).
- name: huihui_ai/qwen2.5-abliterate:7b
# Recommended: vision + Russian/English, ~6GB, abliterated
- name: huihui_ai/qwen2.5-vl-abliterated:7b
default: true
# Lighter / faster (weaker prompts):
# - name: qwen2.5:3b
# Lighter vision:
# - name: huihui_ai/qwen2.5-vl-abliterated:3b
# Text-only abliterate (~5GB):
# - name: huihui_ai/qwen2.5-abliterate:7b
# Official stock (more refusals):
# - name: qwen2.5:7b
# Alternate abliterate pack:
# - name: richardyoung/qwen2.5-7b-instruct-abliterated