v0.3.0 - Feature renaming + Optimized splitting algorithm #8
benbrandt
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What's Changed
Breaking Changes
huggingface -> tokenizers
tiktoken -> tiktoken-rs
Features
Full Changelog: v0.2.2...v0.3.0
This discussion was created from the release v0.3.0 - Feature renaming + Optimized splitting algorithm.
Beta Was this translation helpful? Give feedback.
All reactions