ctranslate2
Subscription: Developer
Active
Subscription: Developer
A fast inference engine for Transformer models that applies quantization, weight pruning, and layer fusion optimizations to deliver efficient CPU and GPU inference for translation, language modeling, and speech recognition workloads.