Update model configurations and enhance LLM runtime logic
- Revised model URLs and descriptions in `llamacpp-models.example.yaml` and `ollama-models.example.yaml` to reflect new recommendations and vision capabilities. - Updated the LLM runtime logic to support vision projectors and improved model resolution handling. - Enhanced the installation script to conditionally include vision projectors when available. - Added tests to validate the inclusion of vision projectors in model presets and ensure proper URL remapping for deprecated models. - Improved documentation to clarify model usage and configuration options.
This commit is contained in:
@@ -1,17 +1,17 @@
|
||||
# Copy to ollama-models.yaml (gitignored). Used when LLM_RUNTIME=ollama.
|
||||
# name = exact tag for `ollama pull`. Empty models: [] → runtime only, no pull.
|
||||
# Purpose: help craft SwarmUI prompts (RU/EN, low refusal).
|
||||
# Purpose: SwarmUI prompt help + vision (RU/EN, low refusal).
|
||||
|
||||
models:
|
||||
# Recommended: Russian+English, ~5GB, low refusal (community abliterate).
|
||||
- name: huihui_ai/qwen2.5-abliterate:7b
|
||||
# Recommended: vision + Russian/English, ~6GB, abliterated
|
||||
- name: huihui_ai/qwen2.5-vl-abliterated:7b
|
||||
default: true
|
||||
|
||||
# Lighter / faster (weaker prompts):
|
||||
# - name: qwen2.5:3b
|
||||
# Lighter vision:
|
||||
# - name: huihui_ai/qwen2.5-vl-abliterated:3b
|
||||
|
||||
# Text-only abliterate (~5GB):
|
||||
# - name: huihui_ai/qwen2.5-abliterate:7b
|
||||
|
||||
# Official stock (more refusals):
|
||||
# - name: qwen2.5:7b
|
||||
|
||||
# Alternate abliterate pack:
|
||||
# - name: richardyoung/qwen2.5-7b-instruct-abliterated
|
||||
|
||||
Reference in New Issue
Block a user