llama.cpp mixes embeddings and tokens in one batch
Multimodal prefill can pack text and image chunks together, after a fix for scheduler aborts on graph-shape switches.
By tensor#ggml
llama.cpp adds GLM-5.3-Flash support
The work also covers a large-context softmax crash and a data race that may affect the full model.
By tensorggml GGUF loader allows integer overflow and enum UB
Fuzzing found two paths where malformed model tensors trigger undefined behavior before validation finishes.
By tensorllama.cpp GGUF reader accepts out-of-range type before checks
A crafted metadata key length can push an invalid enum into the parser, triggering undefined behavior on untrusted model files.
By tensorllama.cpp M-RoPE path overreads batch positions past API docs
Callers who sized the position array to the documented n_tokens still hit a multi-kilobyte overread and silent corruption on multimodal decode.
By tensorllama.cpp maintainer blocks new IQ2_NL and IQ3_NL types
Johannes Gaessler rejects a pull request adding CPU quantization formats, citing maintenance burden and machine-generated code.
By tensorllama.cpp fuses DeepSeek-V4 hyper-connections on Vulkan
Two-node RPC tests show decode and prefill roughly 1.8x faster with lower intermediate memory use.
By tensor