Commit graph

3 commits

Author SHA1 Message Date
Philip Peterson
84e8326e61 ComfyUI with Qwen-Image and SDXL; Ollama keep-alive 30m
ComfyUI serves image generation to Open WebUI on the Tart VM
(ai.quineglobal.com). Models unload when idle on both sides so they
share the 64 GB.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 09:52:07 -08:00
Philip Peterson
4394683542 Give qwen3-coder a 128k context
At 32k, opencode auto-compacted the history four times in four minutes
of reading files; after each summary the model lost the task, and after
the last it started writing tool calls as JSON text. 128k fits in ~31 GB.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:33:33 -08:00
Philip Peterson
e2df9cc0d0 Ollama and opencode setup for the Mac mini
The Ollama LaunchAgent, derived models (mostly to set num_ctx, which
Ollama's OpenAI-compatible API won't take per request), and opencode's
config, now defaulting to qwen3-coder:30b: qwen3:32b tends to end its
turn after thinking without making the tool call it planned.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 07:57:46 -08:00