sageattention
Subscription: Developer
Active
Subscription: Developer
An accurate and efficient 8-bit plug-and-play attention implementation from Tsinghua University, providing quantized attention kernels that significantly reduce GPU memory usage and accelerate transformer inference without sacrificing output quality.
pip install sageattention==1.0.6
1.0.6
Linux