pytokens python library

pytokens

Subscription: Developer
Last updated 20 days ago
Active
Subscription: Developer

A fast and spec-compliant Python tokenizer compatible with the Python 3.14 tokenization specification that runs on older Python versions, providing accurate lexical analysis of Python source code for tooling and static analysis applications.

pip install pytokens==0.4.1
  • 0.4.1
    Linux
    Last updated 20 days ago