BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Allsikt//Article Deadline//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
BEGIN:VEVENT
UID:5a23c737ce7eb2f89da3be6b12df6c44f2d51120@allsikt.tech
DTSTAMP:20260725T033014Z
DTSTART;VALUE=DATE:20260725
DTEND;VALUE=DATE:20260726
SUMMARY:Qwen3.5‑397B‑A17B Runs in 14 GB RAM on M1 Ultra via Paged MoE
DESCRIPTION:Configure the MoE paging with K_override=20\, cache_gb=8.0\, lazy_load=True\, and OUTLIER_MMAP_EXPERTS=0 to run Qwen3.5‑397B‑A17B on a 64GB M1 Ultra with ~14 GB peak RAM.\n\nSource: Reddit r/LocalLLaMA\nOpen: https://allsikt.se/article/qwen3-5-397b-a17b-runs-in-14-gb-ram-on-m1-ultra-via-paged-moe-f6a62af1
URL:https://allsikt.se/article/qwen3-5-397b-a17b-runs-in-14-gb-ram-on-m1-ultra-via-paged-moe-f6a62af1
STATUS:CONFIRMED
TRANSP:TRANSPARENT
END:VEVENT
END:VCALENDAR