Files
gpu-rent/ollama-models.example.yaml
T
Leonid Pershin f17b1c9731 Update Ollama model configurations and documentation for clarity and consistency
- Revised model descriptions in `ollama-models.example.yaml` to emphasize uncensored and abliterated requirements, enhancing user understanding.
- Updated documentation in `llm.md` to reflect changes in model tags and their meanings, ensuring accurate guidance for users.
- Modified CLI help messages to clarify the nature of presets, reinforcing that all options are abliterate models with Russian support.
- Enhanced the `llm_runtime.py` file to align preset labels with the updated model descriptions, improving consistency across the codebase.
2026-08-21 08:54:21 +03:00

14 lines
566 B
YAML

# Copy to ollama-models.yaml (gitignored). Used when LLM_RUNTIME=ollama.
# name = exact tag for `ollama pull`.
# Requirement: uncensored (abliterated) + Russian. Empty models: [] → no pull.
models:
# Recommended (~6GB): vision + RU/EN, abliterated
- name: huihui_ai/qwen2.5-vl-abliterated:7b
default: true
# Presets (setup / up --ollama-preset …):
# light — huihui_ai/qwen2.5-vl-abliterated:3b (~3GB)
# text — huihui_ai/qwen2.5-abliterate:7b (~5GB, no vision)
# big — huihui_ai/qwen2.5-vl-abliterated:32b (~21GB)