Refactor LLM configuration to remove llamacpp support

- Removed references to llamacpp from configuration files, scripts, and documentation, streamlining the LLM setup process to focus solely on Ollama.
- Updated environment variables and paths to eliminate llamacpp-related entries, ensuring clarity in the configuration.
- Adjusted CLI commands and help messages to reflect the removal of llamacpp, enhancing user experience and reducing confusion.
- Revised documentation to provide clear guidance on using Ollama exclusively, including updates to setup instructions and runtime options.
This commit is contained in:
Leonid Pershin
2026-08-21 08:51:36 +03:00
parent 9a4b87dc06
commit 2ab32a8ab5
45 changed files with 139 additions and 1521 deletions
+4 -15
View File
@@ -38,29 +38,18 @@ AUTOCOMPLETE_GITHUB_REF=main
AUTOCOMPLETE_FILENAME=danbooru.csv
SWARMUI_LOCAL_PORT=17801
# Optional LLM beside SwarmUI: none | ollama | llamacpp (setup / --ollama / --llamacpp)
# Optional LLM beside SwarmUI: none | ollama (setup / --ollama / --llm ollama)
# ENABLE_SWARMUI=true
# WORKLOAD=llm # llm-only (no SwarmUI); requires LLM_RUNTIME≠none
# WORKLOAD=llm # llm-only (no SwarmUI); requires LLM_RUNTIME=ollama
LLM_RUNTIME=none
OLLAMA_LOCAL_PORT=17811
LLAMACPP_LOCAL_PORT=17812
# OLLAMA_MODELS_MANIFEST=
# LLAMACPP_MODELS_MANIFEST=
# Pin / тонкая настройка LLM (несecреты; удобнее в gpu-rent.vars — см. кейсы AH):
# LLAMACPP_TAG=b10545
# LLAMACPP_BACKEND=auto
# LLAMACPP_BUILD_CUDA=1
# LLAMACPP_FORCE_REINSTALL=1
# LLAMACPP_ASSET_URL=
# LLAMACPP_SHA256=
# LLAMACPP_NGL=40
# LLAMACPP_CTX=4096
# LLAMACPP_EXTRA_ARGS=--flash-attn on
# Pin Ollama (несecреты; удобнее в gpu-rent.vars):
# OLLAMA_VERSION=0.6.5
# OLLAMA_SHA256=
# CIVITAI_API_TOKEN=
# CIVITAI_API_HOST=civitai.red
# Hugging Face (GGUF / gated HF URLs / capture fallback metadata):
# Hugging Face (HF URLs in models.yaml / capture fallback metadata):
# HF_TOKEN= # or HUGGING_FACE_HUB_TOKEN — https://huggingface.co/settings/tokens
# git pull SwarmUI + extensions on each up (default true). CLI: --no-update
UPDATE_GIT=true