llama.cpp B9406 Release Fixes MTP + MoE Vision Crash
Upgrade to llama.cpp B9406 to fix crash when using MTP + MoE vision models.
Upgrade to llama.cpp B9406 to fix crash when using MTP + MoE vision models.
Summary
The latest llama.cpp release, B9406, addresses a critical crash that occurred when using MTP with MoE models and vision support, specifically the Qwen3.6‑35B‑A3B configuration. The bug manifested as a GGML_ASSERT failure in get_rows / mtmd_helper_decode_image_chunk, causing the application to terminate. The new release includes a patch that ensures proper bounds checking and stabilizes the decoding pipeline for multi‑task, multi‑expert vision models. Developers building local inference pipelines can now compile the updated binary and run MTP + MoE vision workloads without encountering the crash. The release notes encourage users to report any remaining issues and to test the updated build on their hardware.
This fix is essential for teams that rely on llama.cpp for local inference of large, multimodal models, as it restores stability to a previously fragile code path and enables continued experimentation with MoE and vision capabilities.
Key changes
- Release B9406 includes crash fix for MTP + MoE vision models
- GGML_ASSERT failure in get_rows / mtmd_helper_decode_image_chunk resolved
- Supports Qwen3.6‑35B‑A3B configuration
- Stabilizes decoding pipeline for multi‑task, multi‑expert vision workloads
- Updated binary ready for local inference
- Encourages users to report remaining issues
- Improves stability for large multimodal models
- Enables continued experimentation with MoE and vision