Update configuration and documentation for LLM support and local watchdog
- Added `ollama-models.yaml` to .gitignore and implemented logic to copy it in gpu-rent.ps1 and gpu-rent.sh. - Enhanced env.example to include new variables for LLM runtime options and local watchdog configuration. - Updated CLI commands to support LLM options during setup and execution, including new flags for Ollama and llama.cpp. - Improved documentation in cli.md and README.md to reflect changes in LLM integration and local watchdog functionality. - Adjusted architecture and decisions documentation to clarify the role of LLMs and local watchdog in the system.
This commit is contained in:
@@ -0,0 +1,17 @@
|
||||
# Copy to ollama-models.yaml (gitignored). Used when LLM_RUNTIME=ollama.
|
||||
# name = exact tag for `ollama pull`. Empty models: [] → runtime only, no pull.
|
||||
# Purpose: help craft SwarmUI prompts (RU/EN, low refusal).
|
||||
|
||||
models:
|
||||
# Recommended: Russian+English, ~5GB, low refusal (community abliterate).
|
||||
- name: huihui_ai/qwen2.5-abliterate:7b
|
||||
default: true
|
||||
|
||||
# Lighter / faster (weaker prompts):
|
||||
# - name: qwen2.5:3b
|
||||
|
||||
# Official stock (more refusals):
|
||||
# - name: qwen2.5:7b
|
||||
|
||||
# Alternate abliterate pack:
|
||||
# - name: richardyoung/qwen2.5-7b-instruct-abliterated
|
||||
Reference in New Issue
Block a user