Leonid Pershin
2005b00175
- Added `ollama-models.yaml` to .gitignore and implemented logic to copy it in gpu-rent.ps1 and gpu-rent.sh. - Enhanced env.example to include new variables for LLM runtime options and local watchdog configuration. - Updated CLI commands to support LLM options during setup and execution, including new flags for Ollama and llama.cpp. - Improved documentation in cli.md and README.md to reflect changes in LLM integration and local watchdog functionality. - Adjusted architecture and decisions documentation to clarify the role of LLMs and local watchdog in the system.
18 lines
589 B
YAML
18 lines
589 B
YAML
# Copy to ollama-models.yaml (gitignored). Used when LLM_RUNTIME=ollama.
|
|
# name = exact tag for `ollama pull`. Empty models: [] → runtime only, no pull.
|
|
# Purpose: help craft SwarmUI prompts (RU/EN, low refusal).
|
|
|
|
models:
|
|
# Recommended: Russian+English, ~5GB, low refusal (community abliterate).
|
|
- name: huihui_ai/qwen2.5-abliterate:7b
|
|
default: true
|
|
|
|
# Lighter / faster (weaker prompts):
|
|
# - name: qwen2.5:3b
|
|
|
|
# Official stock (more refusals):
|
|
# - name: qwen2.5:7b
|
|
|
|
# Alternate abliterate pack:
|
|
# - name: richardyoung/qwen2.5-7b-instruct-abliterated
|