Leonid PershinandCursor
fe4d8d3a3a
Move prompts into Config/_base and persona folders; seed model facts into SQLite via Ollama embed and retrieve as memory_hits each turn. Co-authored-by: Cursor <cursoragent@cursor.com>
103 lines
4.3 KiB
Markdown
103 lines
4.3 KiB
Markdown
# Swarm Assistent
|
|
|
|
SwarmUI extension for **collaborative Krea 2** prompting via **Ollama**: chat + board (Generate | Refs tabs), LoRA chips, **persona presets** (`Config/personas/`), **vector memory**, model cards with Civitai fetch, img2img/inpaint, slash commands, auto Generate.
|
|
|
|
**Version 0.7.0** — Config/_base + persona folders, skills, memory-seed → SQLite, Ollama `use: chat|memory`, slim inventory via retrieve.
|
|
|
|
## Layout
|
|
|
|
- **Left — Board tabs:** **Generate** (full-height live view) | **Refs** (reference grid + badge `N · vision M`)
|
|
- **Splitter:** drag to resize panes
|
|
- **Right:** Chat | Cards; persona / pack / Ollama chat model; settings gear (memory model + skills)
|
|
- **Chips / slash:** loaded from `Config/_base/ui.json` (persona can override)
|
|
|
|
## Config (bundled + overlay)
|
|
|
|
```
|
|
Config/
|
|
_base/ # defaults (assistant, ui, models/krea2, core, packs, skills, memory-seed, identity)
|
|
personas/<id>/ # sparse preset: persona/voice/likes/dislikes/rules + optional overrides
|
|
```
|
|
|
|
Disk overlay (wins over bundled): `/mnt/swarm_data/Assistent/` — same layout, plus `settings.json`, `taste.json`, `personas.json` (legacy prompt overlay), `ollama-roles.json`, `memory/assistent.sqlite`.
|
|
|
|
Copy `personas/cinema/` → `noir/`, edit only differing JSON files.
|
|
|
|
## Vector memory
|
|
|
|
- SQLite + Ollama `/api/embed` (default `nomic-embed-text`, pick in ⚙)
|
|
- First chat seeds `Config/_base/memory-seed/` (Krea facts, aspect, pitfalls)
|
|
- Agents upsert via patch `memory_upsert` / `memory_forget`
|
|
- Cards ingest on save; retrieve → `memory_hits` in live context (inventory slimmed)
|
|
|
|
## UX
|
|
|
|
- **Send to Assistent** under Generate/History → Ref + Assistent tab
|
|
- Enter sends; Shift+Enter newline; Interrupt cancels chat epoch
|
|
- Manual **Apply + Generate** / `/gen` always generate; Auto-generate checkbox only for LLM auto-path
|
|
- Civitai Confirm required (unless auto-download)
|
|
|
|
### Slash commands (client-side, no LLM)
|
|
|
|
| Command | Effect |
|
|
| --- | --- |
|
|
| `/help` | List commands |
|
|
| `/gen` | Generate now |
|
|
| `/look generate\|refN` | Attach that board window + ask the LLM to look |
|
|
| `/init` `/mask` `/clear` | Same as board buttons |
|
|
| `/interrupt` | Stop generation / cancel chat |
|
|
| `/aspect 16:9` | Set size from the official 1K table |
|
|
| `/seed lock\|random` | Lock or randomize seed |
|
|
| `/vary` | New seed, same prompt (+ generate if auto) |
|
|
| `/pack write\|critique\|…` | Switch pack |
|
|
| `/civitai <query>` | Ask LLM to search Civitai |
|
|
| `/inventory` | Rescan models + refresh LoRA list |
|
|
|
|
## Requirements
|
|
|
|
- SwarmUI with a **Krea 2** checkpoint selected
|
|
- Ollama on `http://127.0.0.1:11434` **on the GPU VM** (gpu-rent `LLM_RUNTIME=ollama`)
|
|
- Chat model + memory embed (`use: memory` in `ollama-models.yaml`; gpu-rent creates CPU variant)
|
|
- Optional: Civitai API key in SwarmUI User Settings
|
|
|
|
## Install
|
|
|
|
```yaml
|
|
swarmui:
|
|
- url: https://gitea.hsrv.site/mrleo1nid/swarm-assistent.git
|
|
ref: main
|
|
dir: swarm-assistent
|
|
requires: ollama
|
|
```
|
|
|
|
Restart / rebuild SwarmUI after clone. gpu-rent: `seed-extensions` + restart.
|
|
|
|
## Packs & skills
|
|
|
|
**Packs** (one active): `write_prompt`, `critique_image`, `compose_scene`, `fix_params`, `inpaint_edit`, `describe_ref`, `catalog_card`.
|
|
|
|
**Skills** (checkboxes): `prompting`, `creativity_sliders`, `memory` — procedures, not model encyclopedia (facts live in memory-seed).
|
|
|
|
**Personas:** `neutral`, `lewd`, `aggressive`, `cinema`, `terse` under `Config/personas/`.
|
|
|
|
## API routes
|
|
|
|
| Route | Role |
|
|
| --- | --- |
|
|
| `AssistentListModels` | Ollama tags → `models` (chat) + `memory_models` |
|
|
| `AssistentGetConfig` | Merged preset for persona (ui, packs, skills, identity) |
|
|
| `AssistentGetSettings` / `AssistentSaveSettings` | Overlay settings (skills, embed_model) |
|
|
| `AssistentListInventory` | LoRA / checkpoint / wildcard inventory |
|
|
| `AssistentListPersonas` | Persona catalog |
|
|
| `AssistentGetPacks` | Prompt pack texts |
|
|
| `AssistentGetCard` / `AssistentSaveCard` | `.assistent.json` cards (+ memory ingest) |
|
|
| `AssistentGetCardMeta` | Local sidecar + optional Civitai by-hash |
|
|
| `AssistentEnqueueWanted` | Wanted YAML queue |
|
|
| `AssistentGetTaste` / `AssistentSaveTaste` | Persistent taste profile |
|
|
| `AssistentSearchCivitai` | Civitai LoRA search |
|
|
| `AssistentChat` / `AssistentChatWS` | Chat (+ memory retrieve + Civitai hop) |
|
|
|
|
## License
|
|
|
|
MIT
|