Add Send to Assistent media button, paste/drop vision image, pane splitter, and polish layout for Krea collaborative chat. Co-authored-by: Cursor <cursoragent@cursor.com>
55 lines
1.7 KiB
Markdown
55 lines
1.7 KiB
Markdown
# Swarm Assistent
|
|
|
|
SwarmUI extension for **collaborative Krea 2** prompting via **Ollama**: chat + vision, LoRA/trigger awareness, and applyable prompt/size patches.
|
|
|
|
## Layout
|
|
|
|
- **Left:** vision reference (drop / paste / *Send to Assistent* from Generate)
|
|
- **Splitter:** drag to resize panes
|
|
- **Right (wider):** chat
|
|
- **Top-right:** prompt pack + settings (Ollama URL, model, auto-attach)
|
|
|
|
## UX
|
|
|
|
- **Send to Assistent** under the current Generate image (and History) — loads vision + opens the Assistent tab
|
|
- Drag images from Generate/History or the OS onto the left pane
|
|
- Paste (`Ctrl+V`) while the Assistent tab is open
|
|
- **Use current** / **Clear** for the vision reference
|
|
- Enter sends; Shift+Enter newline
|
|
|
|
## Requirements
|
|
|
|
- SwarmUI with a **Krea 2** checkpoint selected
|
|
- Ollama on `http://127.0.0.1:11434` (gpu-rent default when `LLM_RUNTIME=ollama`)
|
|
- A chat+vision-capable Ollama model recommended for critique mode
|
|
|
|
## Install
|
|
|
|
Clone into SwarmUI `src/Extensions/swarm-assistent` (or let **gpu-rent** seed it from `extensions.yaml` with `requires: ollama`):
|
|
|
|
```yaml
|
|
swarmui:
|
|
- url: https://gitea.hsrv.site/mrleo1nid/swarm-assistent.git
|
|
ref: main
|
|
dir: swarm-assistent
|
|
requires: ollama
|
|
```
|
|
|
|
Restart / rebuild SwarmUI after clone.
|
|
|
|
## Prompt packs
|
|
|
|
| Pack | Role |
|
|
| --- | --- |
|
|
| `base_krea2` | Always injected: Krea 2 rules + JSON patch contract |
|
|
| `write_prompt` | Craft / improve prompts |
|
|
| `critique_image` | Vision critique → fixes |
|
|
| `compose_scene` | Scene / moodboard |
|
|
| `fix_params` | Width/height/steps/CFG |
|
|
|
|
Live context (checkpoint, LoRAs + triggers, current params) is injected every request.
|
|
|
|
## License
|
|
|
|
MIT
|