Opencode Slow Processing Due to Large System Prompt
Reduce system prompt size in Opencode or switch to pi.dev for faster inference.
Reduce system prompt size in Opencode or switch to pi.dev for faster inference.
Summary
A user reports that Opencode with Qwen3.6-35B-A3B-UD-Q3_K_S.gguf processes prompts at only 21 tokens/s, which is slow compared to pi.dev. The slowdown is attributed to the large system prompt used by Opencode. Switching to pi.dev, which has a smaller system prompt, results in faster processing. The user provides the llama‑server command with numerous flags and notes that the issue is likely related to the system prompt size.
This is a practical insight for developers using Opencode and highlights the impact of system prompt size on inference speed.
The information is useful for optimizing prompt design and choosing between Opencode and pi.dev for local LLM inference.
Key changes
- Opencode with Qwen3.6-35B-A3B-UD-Q3_K_S.gguf yields 21 t/s
- system prompt size causes slowdown
- pi.dev faster due to smaller prompt
- many llama-server flags used