Gentoo Portage Overlays - dev-python/tiktoken

dev-python/tiktoken

fast BPE tokeniser for use with OpenAI's models

Screenshots

https://github.com/openai/tiktoken
https://pypi.org/project/tiktoken/

tiktoken-0.7.0

~amd64

debug python_single_target_python3_10 python_single_target_python3_11 python_single_target_python3_12 debug

View

Download

Browse License: Apache-2.0 Apache-2.0-with-LLVM-exceptions MIT Unicode-DFS-2016 Unlicense

Overlay: powerman

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Runtime Dependencies

tiktoken-0.7.0

python_single_target_python3_10?
      ( dev-lang/python:3.10 )

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )