mrleo1nid/gpu-rent
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update configuration and documentation for LLM support and local watchdog

Browse Source 
- Added `ollama-models.yaml` to .gitignore and implemented logic to copy it in gpu-rent.ps1 and gpu-rent.sh.
- Enhanced env.example to include new variables for LLM runtime options and local watchdog configuration.
- Updated CLI commands to support LLM options during setup and execution, including new flags for Ollama and llama.cpp.
- Improved documentation in cli.md and README.md to reflect changes in LLM integration and local watchdog functionality.
- Adjusted architecture and decisions documentation to clarify the role of LLMs and local watchdog in the system.
This commit is contained in:
Leonid Pershin
2026-08-21 05:29:23 +03:00
parent a9cf2e0f90
commit 2005b00175
43 changed files with 2258 additions and 197 deletions
Download Patch File Download Diff File Expand all files Collapse all files
gpu-rent.vars.example
+5
View File
@@ -15,8 +15,13 @@
# SCAN_POOLS=ru-6,ru-7
# FLAVOR_PREFERENCE=4090-24,4090-48,a5000,a100-40
# SWARMUI_LOCAL_PORT=17801
# LLM_RUNTIME=none
# OLLAMA_LOCAL_PORT=17811
# LLAMACPP_LOCAL_PORT=17812
# IDLE_MINUTES=30
# IDLE_GRACE_MINUTES=45
# LOCAL_WATCHDOG_GRACE_MINUTES=10
# NOTIFY_READY=true
# PULL_OUTPUT=false
# Prefer auto /32 (leave unset). Spike/WARP only:
# GPU_RENT_SSH_CIDR=0.0.0.0/0