ctranslate2
Subscription: Developer
Active
Subscription: Developer
A fast inference engine for Transformer models that applies quantization, weight pruning, and layer fusion optimizations to deliver efficient CPU and GPU inference for translation, language modeling, and speech recognition workloads.
pip install ctranslate2==4.8.4
4.8.4
Linux
4.8.3
Linux
4.8.2
Linux