runai-model-streamer
Subscription: Developer
Active
Subscription: Developer
Core library from Run:ai for streaming large machine learning model weights directly from remote storage into GPU memory, enabling faster model loading times by overlapping download and deserialization during inference server startup.
pip install runai-model-streamer==0.17.0
0.17.0
Linux
0.16.1
Linux