runai-model-streamer-gcs python library

runai-model-streamer-gcs

Subscription: Developer
Last updated 4 days ago
Active
Subscription: Developer

Google Cloud Storage backend for the Run:ai model streamer, enabling direct streaming of machine learning model weights from GCS buckets into GPU memory for fast and efficient model loading during inference server initialization.

pip install runai-model-streamer-gcs==0.17.0
  • 0.17.0
    Linux
    Last updated 4 days ago
  • 0.16.1
    Linux
    Last updated 15 days ago