instanttensor
Subscription: Developer
Active
Subscription: Developer
An ultra-fast distributed loader for Safetensors model files that accelerates the loading of large language model weights across multiple nodes, reducing startup times for distributed inference and training through parallel deserialization.
pip install instanttensor==0.2.2
0.2.2
Linux
0.2.1
Linux
0.2.0
Linux