gpo.zugaina.org

Search Portage & Overlays:

dev-python/tiktoken

fast BPE tokeniser for use with OpenAI's models

Screenshots

  • tiktoken-0.7.0
    ~amd64
    debug python_single_target_python3_10 python_single_target_python3_11 python_single_target_python3_12 debug

    View      Download      Browse     License: Apache-2.0 Apache-2.0-with-LLVM-exceptions MIT Unicode-DFS-2016 Unlicense   
    Overlay: powerman

Runtime Dependencies

tiktoken-0.7.0


python_single_target_python3_10?
      ( dev-lang/python:3.10 )

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )