model-hosting-container-standards
Subscription: Developer
Active
Subscription: Developer
Standardized framework for integrating machine learning frameworks such as vLLM and TensorRT-LLM with Amazon SageMaker hosting, offering consistent ping and invocations endpoints, flexible configuration, and automatic dependency installation.
pip install model_hosting_container_standards==0.1.15
0.1.15
Linux