llama.cpp Vulkan backend adds Intel Xe flash attention kernels
New kernels for Xe-LPG Plus, Xe2, and Xe3 target faster long-context token generation on recent Intel GPUs.
By tensorNew kernels for Xe-LPG Plus, Xe2, and Xe3 target faster long-context token generation on recent Intel GPUs.
By tensorOpt-in graphs on the oneAPI backend show modest decode gains in early Arc tests, with timeouts still under review.
By tensorThe virtual ISA would give LLVM a portable, Intel-specific compilation target alongside existing NVIDIA and AMD GPU backends.
By rvalue