Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix tokenising when using using more than just a-zA-Z #37

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Fix tokenising when using using more than just a-zA-Z #37

wants to merge 1 commit into from

Commits on Nov 30, 2018

  1. Fix tokenising when using using more than just a-zA-Z 

    Previously: `Händler` would be tokenized as `ndler` or `ändler` depending on python version
Rather than the expected `händler`

Solution: use `regexp` rather than `re`.
This gives us the ability to use unicode character clasess such as `[[:upper:]]` and `[[:lower:]]`

Fixes myint#35
    @robotdana
    robotdana committed Nov 30, 2018
    Configuration menu
    Copy the full SHA
    08b4eff View commit details
    Browse the repository at this point in the history