New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Check for Eszett symbol ß in German tokenizer #707

Closed

Hugo-ter-Doest opened this issue Nov 26, 2023 · 1 comment

Collaborator

Hugo-ter-Doest commented Nov 26, 2023

There is also other issues in other language.
For instance the Eszett symbol ß is also not supported.
If you can also check, it will be nice.

Thanks

Originally posted by @sam68740 in #656 (comment)

Collaborator Author

Hugo-ter-Doest commented Nov 29, 2023

Fixed in #709 including support for diacritics

Hugo-ter-Doest closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment