cut-cross-entropy python library

cut-cross-entropy

Subscription: Developer
Last updated 19 days ago
Active
Subscription: Developer

A memory-efficient implementation of the linear cross-entropy loss function from Apple Research, reducing GPU memory usage during language model training by avoiding materialization of the full logit matrix while maintaining numerical accuracy.

pip install cut-cross-entropy==25.1.1
  • 25.1.1
    Linux
    Last updated 19 days ago