flashinfer-python
Subscription: Developer
Active
Subscription: Developer
Kernel library for large language model serving on GPUs, providing high-performance inference kernels optimized for accelerating machine learning tasks with efficient GPU utilization, featuring advanced GPU kernels for fast deployment of LLMs.
pip install flashinfer_python==0.6.18
0.6.18
Linux
0.6.16.post3
Linux
0.6.11.post2
Linux