Update LLM support for llama.cpp and enhance configuration management
- Added support for `llamacpp-models.yaml` in `.gitignore` and implemented logic to copy it in `gpu-rent.ps1` and `gpu-rent.sh`. - Enhanced CLI to prompt for llama.cpp model presets during setup and execution, improving user experience. - Updated configuration handling to include `llamacpp_models_manifest` and related functions for managing llama.cpp models. - Improved documentation in `cli.md` and `llm.md` to reflect changes in llama.cpp integration and model management. - Refactored provisioning logic to handle llama.cpp model downloads and configurations effectively.
This commit is contained in:
@@ -4,6 +4,7 @@
|
||||
!.env.example
|
||||
gpu-rent.vars
|
||||
ollama-models.yaml
|
||||
llamacpp-models.yaml
|
||||
models.yaml
|
||||
extensions.yaml
|
||||
|
||||
|
||||
Reference in New Issue
Block a user