Update Ollama model configurations and documentation for clarity and consistency
- Revised model descriptions in `ollama-models.example.yaml` to emphasize uncensored and abliterated requirements, enhancing user understanding. - Updated documentation in `llm.md` to reflect changes in model tags and their meanings, ensuring accurate guidance for users. - Modified CLI help messages to clarify the nature of presets, reinforcing that all options are abliterate models with Russian support. - Enhanced the `llm_runtime.py` file to align preset labels with the updated model descriptions, improving consistency across the codebase.
This commit is contained in:
@@ -1,15 +1,13 @@
|
||||
# Copy to ollama-models.yaml (gitignored). Used when LLM_RUNTIME=ollama.
|
||||
# name = exact tag for `ollama pull` (Ollama library / community).
|
||||
# Empty models: [] → runtime only, no pull.
|
||||
# Purpose: SwarmUI prompt help — vision + RU/EN on the same GPU as diffusion.
|
||||
# name = exact tag for `ollama pull`.
|
||||
# Requirement: uncensored (abliterated) + Russian. Empty models: [] → no pull.
|
||||
|
||||
models:
|
||||
# Recommended (~6GB): vision + Russian/English, low refusal
|
||||
# Recommended (~6GB): vision + RU/EN, abliterated
|
||||
- name: huihui_ai/qwen2.5-vl-abliterated:7b
|
||||
default: true
|
||||
|
||||
# Alternatives (uncomment / use presets on setup|up):
|
||||
# light — huihui_ai/qwen2.5-vl-abliterated:3b (~3GB)
|
||||
# stock — qwen2.5vl:7b (official library)
|
||||
# text — huihui_ai/qwen2.5-abliterate:7b (no vision, ~5GB)
|
||||
# big — qwen2.5vl:32b (~21GB; llm-only)
|
||||
# Presets (setup / up --ollama-preset …):
|
||||
# light — huihui_ai/qwen2.5-vl-abliterated:3b (~3GB)
|
||||
# text — huihui_ai/qwen2.5-abliterate:7b (~5GB, no vision)
|
||||
# big — huihui_ai/qwen2.5-vl-abliterated:32b (~21GB)
|
||||
|
||||
Reference in New Issue
Block a user