mrleo1nid/gpu-rent
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Seed Assistent personas as overlay folders and tighten Ollama/Assistent glue.

Browse Source 
gpu-rent now writes personas/<id>/ on the VM (not legacy personas.json), adds seed-personas/doctor checks, and shortens mid/high keep-alive now that Assistent parks the LLM before Generate.

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
Leonid Pershin
2026-08-22 01:00:14 +03:00
co-authored by Cursor
parent 789fa26918
commit 03ba4cb6ed
22 changed files with 430 additions and 53 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/test_perf_tiers.py
+2 -2
View File
@@ -82,6 +82,6 @@ def test_ollama_mid_4090_context_16k():
)
tune = ollama_tune_for(info)
assert tune.context_length == 16384
assert tune.keep_alive == "15m"
assert tune.keep_alive == "5m"
assert "OLLAMA_CONTEXT_LENGTH=16384" in "\n".join(ollama_env_lines(tune))
assert "OLLAMA_KEEP_ALIVE=15m" in "\n".join(ollama_env_lines(tune))
assert "OLLAMA_KEEP_ALIVE=5m" in "\n".join(ollama_env_lines(tune))