Skip to content

kimwonj77/tiktokenizer

 
 

Repository files navigation

Tiktokenizer


Tiktokenizer

Online playground for openai/tiktoken, calculating the correct number of tokens for a given prompt.

Special thanks to Diagram for sponsorship and guidance.

CleanShot.2023-03-02.at.22.58.11.mp4

Acknowledgments

About

Online playground for OpenAPI tokenizers

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 91.6%
  • JavaScript 8.3%
  • CSS 0.1%