Update LLM support for llama.cpp and enhance configuration management
- Added support for `llamacpp-models.yaml` in `.gitignore` and implemented logic to copy it in `gpu-rent.ps1` and `gpu-rent.sh`. - Enhanced CLI to prompt for llama.cpp model presets during setup and execution, improving user experience. - Updated configuration handling to include `llamacpp_models_manifest` and related functions for managing llama.cpp models. - Improved documentation in `cli.md` and `llm.md` to reflect changes in llama.cpp integration and model management. - Refactored provisioning logic to handle llama.cpp model downloads and configurations effectively.
This commit is contained in:
@@ -99,6 +99,10 @@ if [[ ! -f "$ROOT/ollama-models.yaml" && -f "$ROOT/ollama-models.example.yaml" ]
|
||||
cp "$ROOT/ollama-models.example.yaml" "$ROOT/ollama-models.yaml"
|
||||
echo "gpu-rent: created ollama-models.yaml"
|
||||
fi
|
||||
if [[ ! -f "$ROOT/llamacpp-models.yaml" && -f "$ROOT/llamacpp-models.example.yaml" ]]; then
|
||||
cp "$ROOT/llamacpp-models.example.yaml" "$ROOT/llamacpp-models.yaml"
|
||||
echo "gpu-rent: created llamacpp-models.yaml"
|
||||
fi
|
||||
if [[ ! -f "$ROOT/gpu-rent.vars" && -f "$ROOT/gpu-rent.vars.example" ]]; then
|
||||
cp "$ROOT/gpu-rent.vars.example" "$ROOT/gpu-rent.vars"
|
||||
echo "gpu-rent: created gpu-rent.vars"
|
||||
|
||||
Reference in New Issue
Block a user