flashinfer-python
Subscription: Developer
Active
Subscription: Developer
Kernel library for large language model serving on GPUs, providing high-performance inference kernels optimized for accelerating machine learning tasks with efficient GPU utilization, featuring advanced GPU kernels for fast deployment of LLMs.
pip install flashinfer-python==0.7.0.post1
0.7.0.post1
Linux
0.6.18.post1
Linux
0.6.18
Linux
0.6.16.post3
Linux
0.6.11.post2
Linux