compressed-tensors python library

compressed-tensors

Subscription: Developer
Last updated 16 days ago
Active
Subscription: Developer

Library for utilizing compressed safetensors of neural network models, supporting quantization and sparsity schemes like GPTQ, AWQ, SmoothQuant, INT8, FP8, SparseGPT, providing efficient storage and management of optimized model data.

pip install compressed-tensors==0.18.0
  • 0.18.0
    Linux
    Last updated 16 days ago
  • 0.17.0
    Linux
    Last updated 2 months ago
  • 0.15.0.1
    Linux
    Last updated 2 months ago