Search Portage & Overlays:
Newest
News
Repository news
GLSAs
Browse
USE Flags
Overlays
More...
dev-python
/tiktoken
fast BPE tokeniser for use with OpenAI's models
Screenshots
https://github.com/openai/tiktoken
https://pypi.org/project/tiktoken/
tiktoken-0.7.0
~amd64
debug python_single_target_python3_10 python_single_target_python3_11 python_single_target_python3_12 debug
View
Download
Browse
License: Apache-2.0 Apache-2.0-with-LLVM-exceptions MIT Unicode-DFS-2016 Unlicense
Overlay:
powerman
ChangeLog
USE Flags
Dependencies
Reverse Deps
Related Bugs
View 
Download 
Browse License: Apache-2.0 Apache-2.0-with-LLVM-exceptions MIT Unicode-DFS-2016 Unlicense
