runai-model-streamer python library

runai-model-streamer

Subscription: Developer
No updates yet
Active
Subscription: Developer

Core library from Run:ai for streaming large machine learning model weights directly from remote storage into GPU memory, enabling faster model loading times by overlapping download and deserialization during inference server startup.