PyTorch CPU grouped matmul may stop looping over experts
An AMD proposal would run mixture-of-experts grouped GEMMs as one oneDNN call on Zen CPUs, with about a 2x gain on published expert shapes.
By tensor#moe
Hugging Face seeks MXFP4 backward kernels for GPT-OSS training
Forward-only 4-bit support forces a costly upcast, blocking native low-precision fine-tuning on modern NVIDIA GPUs.
By tensorllama.cpp adds GLM-5.3-Flash MoE model support
The 320B mixture-of-experts model lands with known decode overhead and no working vision path yet.
By tensorllama.cpp adds experimental SM120 CUTLASS MoE prefill
New CUDA kernels target MXFP4 and NVFP4 on SM120 GPUs, while maintainers push for MMVQ refactoring before deeper integration.
By tensorllama.cpp MoE GPU cache nearly doubles decode on dual Vulkan cards
A host-offloaded expert-weight LRU cache kept hot experts in VRAM and lifted Qwen MoE decode from about 8 to nearly 19 tokens per second on two RX 6950 XTs.
By tensor