Qwen3.6 Preserve_Thinking Bug in llama-server v9102
Patch the llama-server config by removing spaces in chat-template-kwargs JSON strings to enable preserve_thinking in llama-server v9102.
Patch the llama-server config by removing spaces in chat-template-kwargs JSON strings to enable preserve_thinking in llama-server v9102.
Summary
The preserve_thinking parameter in Qwen3.6 fails when the chat-template-kwargs JSON string contains spaces in the ini file. Removing the spaces restores the feature. The issue was discovered by sending a prompt that checks for consistent hidden number output across guesses. The environment was llama-server v9102 (commit 7d442abf5) running on an RTX 4090. The bug appears to be a minor JSON parsing quirk in the ini parser of llama-server. Users can verify the fix by testing the same prompt after adjusting the config.
This is a non‑security bug that affects developers using llama-server to enable preserve_thinking. It does not impact WordPress or e‑commerce customers directly.
The fix is straightforward: edit the models.ini file to remove spaces around the JSON key/value pairs in chat-template-kwargs.
Key changes
- preserve_thinking fails when chat-template-kwargs JSON contains spaces
- works when JSON string has no spaces
- verified by prompt that hidden number remains consistent
- environment: llama-server v9102, RTX 4090
- likely a JSON parser bug in ini file
- minor parsing quirk