PyTorch split rewrite breaks vLLM QK-norm RoPE fusion
A functionalization change that turns multi-output splits into slices leaves vLLM’s pattern matcher with nothing to fuse under Inductor graph partition.
By tensorA functionalization change that turns multi-output splits into slices leaves vLLM’s pattern matcher with nothing to fuse under Inductor graph partition.
By tensorComplex dtypes can now go through the compiler via a real-valued decomposition path that must be opted in explicitly.
By tensorStrided and offset tensor paths in the compiler could read past valid memory without raising an error.
By tensorThe attribute would let the compiler enforce at-most-once calls and reason about closure captures alongside non-copyable types.
By segfault